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. We  are  making  choices  based  on  some  sort  of  eval- 
uation every  day  of  our  lives.  Comparisons,  either 
qualitative  or  Quantitative  are  the  basis  of  measure- 
ment, whether  the'"-  ^re  stated  or  implied.  ^o  state 
or  to  assume  that  L'r.  Jones  is  cultured  or  well  edu- 
cated is  common  practice,  and  yet  we  would  hardly 
dignify  it  by  calling  it  measurement.  The  question 
is  how  well  educated  or  how  cultured  is  Mr.  Jones  and 
on  what  do  v/e  base  our  judgment? 

Watson  (1)  tells  a story  of  a group  of  school 
men,  who  in  the  early  days  of  measurement  emphasis 
came  together  to  talk  about  tests.  One  was  fervently 
opposing  the  notion  that  certain  aspects  of  mental  life 
could  be  measured  by  any  foot  rule.  He  closed  his 
protest  with,  "Who  would  presume  to  measure  the  intellect 
of  a Milton  or  a Shakespeare?" 

(1)  Watson,  G.  B.  "Expermentation  and  measurement  in 
Religious  Education"  Associ^t i Fress  1927,  P.-34. 
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Thorndike  arose  and  answered,  "Fortunately  it  is 
not  necessary  for  us  to  measure  the  intellect  of  a 
Milton  or  a Shakespeare.  That  has  already  been  done 
by  the  previous  speaker.  They  have  not  only  been 
measured  but  placed  at  the  head  of  the  list.  It  now 
remains  only  to  find  out  where  the  rest  of  the  human 
race  stands  with  reference  to  them.  11 

The  politician  who  writes  a letter  of  recommend- 
ation for  a"friend"  has  as  his  purpose  evaluation, 
whether  it  is  real  or"  imagined*  This  is  in  a sense 
measurement,  but  if  he  were  to  compare  the  one  for  whom 
he  was  writing  with  another  individual,  known  to  both 
the  recipient  and  the  writer  of  the  letter,  we  could 
safely  regard  this  as  the  first  step  in  the  refine- 
ment process. 

There  is  great  need  for  a refined,  reliable  system 
of  measurement  for  all  walks  of  life.  The  fact  that  a 
prospective  army  officer  may  be  perfect  in  army  routine 
and  not  have  the  faculty  or  leadership  ability  to  command 
or  lead  men;  that  a prospective  salesman  may  have  complete 
knowledge  of  the  material  he  is  to  handle,  and  not  be 
able  to  make  a sale;  that  a teacher  may  have  every 
academic  requirement  and  not  be  a good  teacher;  that  a 
student  may  have  knowledge  of  a body  of  information  and 
lack  the  proper  attitudes  and  abilities  to  put  it  to  use; 


-o- 


that  a person  may  subscribe  to  any  system  of  dogma 
or  creed  and  still  not  have  any  religion;  that  a 
college  graduate  may  have  the  highest  possible  academic 
standing  and  still  fail  in  one  position  after  another, 
points  immediately  to  the  fact  that  there  is  an  educa- 
tion outside  the  regularly  accepted  curriculum,  and  a 
sphere  of  experience  which  we  cannot  afford  to  over- 
look. 

This  phase  of  human  make-up  has  been  character- 
ized by  various  terms,  among  which  are  dynamic  qualities, 
character  traits,  and  personality  (in  the  broadest  sense). 
The  need  for  a system  of  measurement  to  indicate  not  only 
the  presence  or  absence  of  these  qualities  but  the  degree 
of  their  presence  or  absence  has  been  keenly  felt  since 
before  1910. 

What  type  of  man  must  I have  for  this  position  or 
that  position?;  or  which  one  of  these  faithful  employees 
ought  I to  make  foreman?;  are  questions  often  asked  in 
the  field  of  business  and  industry.  The  principle  of 
mass  production  and  the  necessity  for  economy  demands 
a wise  selection  of  personel.  Professor  Walter  Dill 
Scott (1)  and  a seminar  at  Carnegie  Institute  of  Techno- 
logy, of  which  he  was  leader,  created  the  first  man- 
to-man  rating  scale,  in  an  ef  'ort  to  meet  this  need. 

(1)  Rugg,  Harold  "is  the  Rating  of  Human  Character 
Practicable.  ' Journa  1 Educational  Psychology, Nov <>1921 
P.  427. 
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Considerable  progress  has  been  made  since  then,  but  the 
need  for  better,  more  refined  procedure  is  everywhere 
evident . 

The  World  War  found  us  in  1917  with  a huge  army  to 
raise  and  equip  end  a host  of  officers  to  train.  On 
what  basis  were  men  in  the  various  Officer’s  Training 
Camps  to  be  assigned  to  the  several  branches  of  the 
service?  Who  were  the  best  and  who  were  in  line  for 
promotion  to  important  posts?  Which  ones  were  able  to 
carry  the  most  responsibility?  -The  peed  for  some  scheme 
of  evaluating  the  capacities  and  qualities  of  men  was 
keenly  felt.  Sacrifice  of  time,  material  and  even 
human  life  was  the  penalty  for  mistakes.  The  Army 
Hating  Scale  (1)  was  developed  by  Rugg  and  several 
others,  under  most  ideal  conditions  and,  was  in  a 
measure  successful.  Many  additional  experiments  have 
been  and  are  constantly  being  made,  which  is  a very 
real  testimony  to  the  need  of  adequate  measurement  of 
abilities,  capacities,  habits  and  qualities. 

In  the  field  of  Education,  Boyce  (2)  points  out 
very  definite  needs  for  measurement  as  it  pertains  to  the 

(1)  Rugg,  Harold- Journal  of  Education  Psychology, 

Nov.  1921,  Page  428  ("is  the  Rating  Human  Character 

Practicable " ) 

(2)  Boyce,  Arthur  Clif ton-14tv  Yearbook,  National  Society 
for  the  Study  of  Education  Part  2,  PP  9-10 
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admini strati on  of  a school  or  of  a system  of  schools. 

The  need  exists  first  in  the  vocational  guidance  of 
teachers,  particularly  in  aiding  to  discover  the  school 
grade  and  the  type  of  work  for  which  one  is  best  fitted. 
Secondly,  in  the  improvement  of  teachers  in  service  hy 
providing  a basis  for  self-criticism  and  self-improve- 
ment, Thirdly,  as  a basis  for  the  determination  of 
promotion  and  dismissal,  and  salary  schedule. 

Another  evidence  of  the  need  for  measurement  in  the 
field  of  education  is  the  inadequacy  of  the  present 
basis  of  measurement,  or  system  of  grading.  Robertson 

(1)  points  out  that,  ’Education  is  a process  of  bring- 
ing about  desired  changes  in  people,  and  the  present 
system  is  attempting  to  measure  change  in  terms  of 

A,  B,  G,  & D,  or  0 to  100  in  knowledge  of  subjects.  1 
Thus  only  a portion  of  the  total  education  of  a person 
is  being  measured  and  that  portion  very  inadequately, 

(2)  Elliott  and  Starck  showed  that  in  a fairly  objective 
subject  like  mathematics  one  hundred  experienced  teachers 
of  the  subject  assigned,  on  the  same  set  of  actual 
replies  to  an  examination  paper,  grades  varying  from 

28  to  90. 

(1)  Robertson,  David  Allan  - 'Character  Processes  in  Col- 
leges and  Universities,'  Religious  Education, Hay,  1930  P.393 

/o\  It  tt  it  it  it  it  It  It  it  it  It  It  It  II  II  It 
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The  probability  is  that  most  objective  examinations 
will  not  show  as  wide  a degree  of  variance  as  the  above, 
but  the  fact  still  remains  that  there  is  a degree  of 
subjectivity  in  the  most  objective  type  of  test. 

Meanwhile,  what  of  Religious  Education?  Very 
little  has  been  done,  but  the  need  is  perhaps  more 
apparent  here  than  in  any  other  field.  The  great  mass 
of  teachers  have  little  or  no  educational  consciousness 
and  ministers  many  times  have  less  than  the  teachers. 

The  spirit  seems  to  be,  - "We  don’t  know  where  we’re 
going  but  we’re  on  our  way. 1 About  the  only  widely  used 
type  of  measurement,  both  in  the  so-called  "Sunday  School" 
and  in  the  Church  is  attendance  records  as  an  indication 
of  the  quality  of  the  program.  Sometimes,  the  attendance 
records  indicate  something  about  program  but  they  may 
also  indicate  the  influence  of  high-pressure  contests 
and  kindred  activities,  which  are  a direct  confession 
of  lack  of  program. 

The  main  problem  facing  the  Church  today  is  the 
creation  of  a trained  leadership.  How  shall  we  know 
when  this  leadership  is  trained?  When  it  has  mastered 
a certain  body  of  knowledge?  Who  is  fitted  to  teach 
and  who  is  not?  What  about  the  religious  and  social 
attitudes  of  boys  and  girls?  How  can  we  find  out  the 
presence  or  absence  of  religious,  moral,  social, 


ethical 
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ideals.  A great  need  is  apparent  to  even  the  casual 
observer. 

B.  DEFINITION  OF  RELIGIOUS  EDUCATION  IN  TERMS  OF  OBJECTIVES. 

What  is  Religious  Education?  Coe  (1)  says,  "it 
is  the  systematic,  critical  examination  and  reconstruction 
of  relations  between  persons  guided  by  Jesus'  assumption 
that  persons  are  of  infinite  worth,  and  by  the  hypothesis 
of  the  existence  of  God,  the  Great  Valuer  of  Persons51. 

Many  people  would  not  be  satisfied  wi th  this  as  a defini- 
tion. However,  we  are  not  as  much  concerned  with  an 
academic  definition  of  religious  education  as  we  are  with 
some  knowledge  of  the  outcomes  or  oals  which  we  strive 
to  attain  through  the  process  of  Religious  Education. 

Discussing  the  need  for  comprehensive  objectives 
Bower  (2)  says,  "In  the  light  of  our  present  knowledge 
of  the  spiritual  needs  of  persons  and  society,  the 
statement  of  general  objectives  might  well  assume  four 
forms;  in  terms  of  personal  life,  the  development  of  a 
complete,  satisfying  and  effective  Christian  personality; 
in  terms  of  knowledge,  such  acquaintance  with  racial 
reli  ious  experience  as  will  help  the  learner  to  arrive 

(1)  Coe,  George  A. -"What  is  Christian  Education?"  P.296 

Scribners  1929 

(2)  Bower,  W. C . -“Religious  Education  in  the  Modern  Church" 

Bethany  Press  1929.  P.36 
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at  convictions  of  his  own  concerning  the  religions 
values  of  life;  in  terms  of  the  Christian  institution, 
an  aware  and  effective  Church  as  a specialized  agency 
for  the  interpretation  and  promotion  of  Christian  ideals 
and  purposes;  in  terms  of  the  great  society,  the  gradual 
and  progressive  reconstruction  of  social  relations  and 
functions  on  a spiritual  basis." 

These  four  aims  are  indeed  comprehensive.  They 
appear  individually  as  the  dominant  emphasis  of  the 
Church  for  given  periods  in  its  history.  Piske  (1) 
describes  the  aims  of  Clement  and  Origen  as  the  teaching 
of  Christian  virtues  and  the  Christian  education  of 
body,  mind  and  spirit  (personal  life) ; the  aim  for  a 
thousand  years  after  Constantine  as  keeping  the  Church 
alive  and  training  leaders  for  it* (an  aware  and  effective 
Church) ; the  aim  of  the  reformation  as  a doctrinal  or 
knowledge  aim  (knowledge);  the  aim  of  the  early  nine- 
teenth century  as  evangelistic  (the  great  society). 

The  most  recent  and  widely  accepted  list  of 
objectives  for  Religious  Education  is  submitted  by 
Veith  ( 2) . 

(1)  Piske,  G-.k . -"Purpose  in  Teaching  Religion'1  PP  42-45 

Abbington  Press  1927 

(2)  Veith,  Paul  H. -"Objectives  in  Religious  hducation" 

PP  80-89  Harpers  1930 
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1.  "To  foster  in  growing  persons  a consciousness 
of  God  as  a reality  in  human  experience,  and  a sense  of 
personal  relationship  to  him". 

2.  '''To  lead  rowing  persons  to  an  understanding 
and  appreciation  of  the  personality,  life,  and  teachings 
of  Jesus  Christ ". 

3.  uTo  foster  in  growing  persons  a progressive 
and  continuous  development  of  Christ-like  character’. 

4.  :iTo  develop  in  growing  persons  the  ability  and 
disposition  to  participate  in  and  contribute  construct- 
ively to  the  building  of  a social  order  embodying  the 
ideal  of  the  fatherhood  of  God  and  the  brotherhood  of 
man1' . 

5.  "To  lead  growing  persons  to  build  a life  philo- 
sophy on  the  basis  of  a Christian  interpretation  of 
life  and  the  universe”. 

6.  "To  develop  in  growing  persons  the  abilit:/  and 
disposition  to  participate  in  the  organized  society  of 
Christians  - the  Church". 

7.  "To  effect  in  growing  persons  the  assimilation 

of  the  best  religious  experience  of  the  race,  as  effective 
guidance  to  present  experience". 

No  attempt  is  here  made  to  make  these  seven  objectives 
more  specific.  They  comprise,  as  they  are,  a good 
working  definition  of  religious  education. 
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The  assumption  inherent  in  the  above  seven  statements 
is  that  religious  education  is  a process.  The  primary 
concern  is  persons  and  the  progressive  development  of 
persons  in  their  natural  and  normal  relationships.  The 
starting  point  is  experience  and  the  process  is  the 
understanding,  analysis,  criticism  and  evaluation  of  ex- 
perience. Bower(l)  says  of  the  curriculum,  "When  it  is 
approached  in  this  way  the  curriculum  of  religious  edu- 
cation becomes  the  experience  of  the  learner  as  that  ex- 
perience undergoes  interpretation,  enrichment,  and  control 
in  terms  of  religious  ideas,  ideals,  and  purposes'1. 

Religious  Education  is  thus  a voyage  of  discovery  for 
each  person  rather  than  the  assimilation  of  a body  of 
material,  preconceived  ideas,  etc. 

Thus  construed,  religion  becomes  a quality  of  all 
life,  and  measurement  in  Religious  Education  becomes  a 
technique  of  discovering  the  presence  or  absence  and  the 
degree  of  the  presence  or  absence  of  the  desirable 
qualities  or  objectives  in  the  normal,  every-day  expe- 
rience of  the  learner. 

G.  WHAT  OUGHT  V.E  TRY  TO  MEASURE  IN  RELIGIOUS  EDUCATION. 

(1)  Lotz  and  Crawford- 11  Studies  in  Religious  Education11  P.182 

Cokesbury  Press  1931 
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The  personalist  would  say  we  ought  to  attempt  to 
measure  Christian  personality.  This  furnishes  difficulties, 
however,  in  the  possibility  of  misunderstanding  in  the  use 
of  the  term.  We  usually  think  of  personality  as  being  the 
composite  of  tact,  physical  appearance,  enthusiasm,  etc., 
while  character  has  a different  connotation.  McDougall  de- 
fines character  as  follows:  (1)  "Ch°raoter  is  the  system 

of  directed  conative  tendencies.  It  may  ^e  relatively 
simple  or  complex;  it  may  be  harmoniously  organized  or 
lacking  in  harmony,  it  may  be  firmly  or  loosely  knit;  it 
may  be  directed  in  the  main  toward  lower  or  higher  goals." 

Two  elements  are  evident  in  the  above  definition. 

First,  active  tendencies  are  directed.  Secondly,  active 
tendencies  may  be  systematized  or  organized  about  dominant 
life  purposes.  Thus,  character,  as  we  popularly  know  it,  has 
a moral  connotation  which  we  do  not  associate  with  the  popular 
concept  of  personality. 

Brandenburg  (2)  attempted  to  measure  personality  in  its 
complete  form,  defining  °s  accurately  as  possible  his  terms. 

He  understood  personality  to  indicate  a composite  of  an 
individual’s  tyrioal  reactions,  physical  intellectual  and 
emotional,  to  his  environment,  together  vith  his  various 
physical  characteristics  which  constitute  appearance". 

(1)  McDougall,  Wm. --"Outline  of  Psychology--Scribners  1923 

p.417. 

(2)  Brandenburg,  George  C . --"Analyzing  Personality" 

Journal  Applied  Psychology  June  1925  PF  139-155 

Sept. 1925  PF  281-292. 
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Thus  personality  is  construed  as  a broad  term  inclusive 
of  what  we  popularly  know  as  character.  He  used  twenty- 
three  traits  in  which  twenty-nine  students  rated  one  another. 
The  list  of  twenty-three  traits  is  as  follows: -PI  142-143: 

12.  Reasoning  Ability, 

13.  General  Information. 

14.  Originality. 

15.  Sympathy . 

15.  Speed  in  Work . 

17.  Social  & Civic  interest. 

18.  Address. 

19.  Sincerity. 

20.  Industrv. 

21.  Rertness. 

22.  Appreciation  of  humor. 

23.  Moral  habits. 

He  developed  some  interesting  inter-correlations, 
and  some  interesting  conclusions  regarding  vocational  life. 

Unfortunately,  this  type  of  approach  will  not  suffice 
for  religious  education.  It  is  too  general  and  not  all- 
inclusive  . 

In  direct  contrast  with  this  rather  general  attempt  to 
measure  '’personality"  Hartshorne  and  May  (1)  attempted  a 
specific  measurement  of  character  and  divided  the  field  of 


1. 

Accuracy  in  Work. 

12. 

2. 

Enthusiasm. 

13. 

3. 

Aggressiveness , 

14. 

4. 

Self-reliance . 

15. 

5. 

Memory. 

• 

CO 

1 — 1 

6 . 

Popularity. 

• 

« — 1 

7. 

Motor  Ability. 

18. 

8. 

Tact . 

19. 

9. 

Genera  .1  Ab  :*  1 i t y . 

20. 

10 

. Reliability. 

21. 

11 

. Co-operation. 

22. 

23. 

(1)  Hartshorne,  Hugh  and  May,  Mark  A "Testing  the  Knowledge 
of  right  and  wrong"  Monograph  1927 
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character  study,  in  which  tests  are  called  for,  as  follows: 

1.  Mental  content  and  skills,  the  so-called  intel- 
lectual factors. 

2.  Desires,  attitudes,  motives,  etc.,  the  dynamic 
factors . 

3.  Social  behavior,  the  performance  factors. 

4.  Self-control,  the  relation  of  all  these  factors 
to  one  another  and  to  social  self -organization. 

Thirteen  tests  were  constructed  in  an  effort  to 
measure  item  one,  and  used  in  sufficient  numbers  to  warrant 
statistical  treatment.  They  were  divided  as  follows: 

A.  Word  Tests 

1.  Opposites  - A multiple  choice  test  in  which  the 
subject  was  required  to  write  in  the  bracket  the  word  most 
nearly  opposite  in  meaning  to  the  one  in  capital  letters 
to  the  left. 

1.  GIVE  1-Present,  2-Accept,  3-take,  4-wish,  5-absent, 

( ). 

2.  FRIEl'D  1-soldier,  2-true,  3-false,  4-enemy,  5-fight, 

( ). 

2.  Similarities  - A cross  out  test  in  which  the  subject 
was  asked  to  cross  out  the  odd  word. 

1.  1-debase,  2-ignore,  3-humble,  4-disgrace,  5-lower 

2.  1-quit,  2-surrender,  3-enemy,  4-relinquish,  5-forsake 


c 

- 


< -- 
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3.  Word  Consequences  - A multiple  choice  test  in 
which  subject  was  asked  to  indicate;  (1)  likely  conse- 
quences to  actions  indicated  in  capital  letters, 

(2)  the  most  likely  consequences,  (3)  the  best  con- 
sequences, (4)  the  worst  consequences. 

1,  CHS AT IMG  - 1-courage,  2-forgery,  3-outcast, 

4-wealth,  5-poverty. 

2.  BETTING  - 1-gambling,  2-poverty,  3-optimism, 

4-wealth,  5-war. 

B - Sentence  Tests 

4.  Cause  and  effect  - a true-false  test  with 
IOC  items  such  as  the  following  in  which  subject  under- 
lines true  or  false. 

1.  Good  marks  are  chiefly  a matter  of  luck  - true  false 

2.  Success  always  comes  from  hard  work  - true  false 

5.  Duties  - modified  true  - false  test  with 
modified  response  indicating  whether  the  act  is  his  duty, 
not  his  duty,  sometimes,  sometimes  not  his  duty. 

1.  To  help  a slow  or  dull  child  with  his  lessons, 

true  ? false 

2.  To  read  the  newspaper  everyday.  - true  ? false 

6.  Comprehensions  - multiple  choice  response  to 
situations . 


1.  If  someone  asks  to  borrow  your  pencil 
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(a)  Tell  him  it  is  broken. 

(b)  Tell  him  that  you  lost  it. 

(c)  Tell  him  that  you  don't  want  to  lend  it. 

(d)  Let  him  take  it. 

7.  Provocations  - Illustrations. 

Stories  of  Children.  Subject  askea  to  decide  whether 
right,  wrong  or  excusable  by  encircling  one  of  the 
possible  answers. 

1.  Helen  noticed  that  everyone  in  the  class  was 
cheating  so  she  cheated  too. R.  Ex.  ,.:r. 

8.  Foresights  - No  suggestion  eiven  to  possible 
consequences.  Subjects  asked  to  fill  in. 

1.  Whenever  anyone  picked  on  John,  he  would  go 
and  tell  his  teacher. 

(Space  for  a large  number  of  consequences). 

9.  Recognitions  - Multiple  choice  test  in 
which  subject  encircles  response.  C.  Por  cheating,  L. 
for  L^irg,  S.  stealing,  something  wrong  but  neither 

cheat in0,  lyinfc  or  stealing  encircle  x,  if  r.ot  wrong 
encircle  J. 

1.  Bullying  younger  children  C L S X J 

2.  Using  street  car  transfers  which 

are  out  of  date  C L S X J 

10.  Principles  - A true-false  test 

1.  To  master  one’s  self  is  a greater  thing  than 

to  win  a battle  true,  false. 

2.  Clean  speech  is  a sign  of  being  gcody-goody 
true,  false. 


t 
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ll . Applications  - A multiple  choice  test 
using  elements  in  provocations  and  principle  tests. 

12.  Social-ethical  vocabulary  - Subject 
places  the  number  of  the  word,  that  means  the  same  or 
most  nearly  the  same  as  the  word  in  Capitals,  on  the  right* 

1.  BRAVERY  - 1-folly,  2-courage,  3-livery, 

4-Xmrert 1 r er ce , 5 -human i tv  • 

2.  SCORE  - 1-sccld,  2-angry,  3-make  fun  of, 

4-extol,  5-expound . 

C.  Good  Manners  Test  - true,  false. 

A.  - If  soup  or  any  liauid  is  too  hot,  blow  on  it 
slightly  to  cool  it true,  false. 

After  preliminary  experimentation  these  tests  were 
revised  and  some  of  the  tests  were  thrown  out  on  the 
following  bases; 

1.  Items  with  ambiguous  or  localized  answers. 

2.  Items  on  which  ninety  percent  of  the  children  agreed. 

3.  Tests  correlating  highly  with  intelligence  and 
having  no  independent  value. 

Thus  ten- tests  o°  two  forms  e^ch  were  left.  Interesting 
correlations  aur*  intercorrelations  ”rQ''',e  computed  °rd  con- 
clusions drawn. 

While  the  religious  educator  must  be  concerned  with  a 
more  detailed  measurement  of  character  habits  than  that 
attempted  by  Brandenburg,  it  is  hardly  probable  that  the 
highly  technical  attempts  of  Kartshorne  end  May  will  beccme 
common  practice  for  some  time  to  come. 


-17- 


In  the  one  illustration  we  have  an  attempt  to  judge 
the  presence  or  absence  of  abstract  personality  traits. 

In  the  other,  the  attempt  to  discover  specific  mental 
skills.  This  is  not,  bov/ever,  a case  of  the  testing 
method  versus  the  rating  method,  but  rather  the  attempt 
to  measure  specific  habits  and  skills  versus  the 
attempt  to  measure  abstract  personality  traits,  the 
existence  of  which  3s  doubtful. 

When  then  ought  we  to  measure  in  Religious  Education? 

1.  Mental  content  and  skills. 

2.  Desires,  attitudes,  motives,  etc. 

3.  Social  behavior, 

4.  Self-control,  the  relation  of  all  these 
factors  to  one  another  and  to  social  self-organization. 


Chapter  II 

Significant  Developments 
in  the  Field  of  Measurement, 
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A.  ..  'I CAL  ETCH  OF  THE  MEASUREMENT  MOVEMENT. 

Chave  (1)  described  an  early  attempt  at  measure- 
ment during  the  sixteenth  century  which  has  come  to 
us  through  the  history  of  English  law.  In  1864  an 
English  school-master  invented  a scale  hook  for 
me  a sur ing  school  sub  j e c t s . 

In  1904  the  publishing  of  Thorndike  1 s book,  ’’Mental 
and  Social  measurements”,  brought  new  techniques  of 
statistics  and  measurement. 

In  1905  the  first  standardized  intelligence  tests, 

( Binet- Simon)  came  with  the  creation  of  schools  for 
subnormal  children  in  France . 

In  1910  Elliott  developed  an  elaborate  scheme  of 
some  hundred  traits  which  was  entirely  subjective. 

Rugg  (2)  and  several  others  worked  out  several  ratings 
and  correlations,  sometimes  with  several  teachers  rated 
simultaneously,  but  no  correlation  exceeded  0.2. 

Boyce  followed  this  with  a scale  of  forty-five 
qualities  with  ten  divisions  which  was  a bit  less 
cumbersome,  but  it  was  purely  subjective  with  nothing 
external  against  which  to  check. 

(1)  Chave,  E. J. -’’Studies  in  Religious  Education”  op  130-132 

Editors--Lotz  and  Crawford  Cokesbury  Fress  1931. 

(2)  , . . 0 . - ” Is  the  Rating  of  Lui  m Character  Pr  ’.cable” 

P.  426,  Journal  Education  Psychology  Fov.  1922 
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Shortly  after  this,  a seminar  at  Carnegie  Institute 
of  Technology  under  the  leadership  of  Professor  Y/alter 
Dill  Scott,  developed  the  idea  of  man- to -man  comparison 
as  a measure  of  greater  objectivity,  and  from  this  came 
the  man- to -man  rating  scale  known  as  the  ranking  method. 

In  1917  and  1918,  Rugg  and  several  others  developed 
the  man-to-man  rating  scale  into  the  Army  Rating  Scale, 
a scale  of  five  qualities,  which  was  applied  to  educational 
work  in  the  Detroit  scale  (1)  for  rating  teachers  and  in 
the  Pressey  (1)  card  for  rating  pupils. 

Dealing  with  the  significant  advance  in  measure- 
ment in  1921,  Haggerty  (1)  refers  to  the  extension  of 
intelligence  examinations  and  the  advan ce  in  the  use 
of  these  tests  as  the  greatest  development  in  the 
measurement  movement.  This  very  advance  made  necessary 
and  called  into  use  achievement  tests  and  other  measures 
of  school  progress.  By  1921  intelligence  tests  had 
been  developed  for  the  whole  school  range.  However,  this 
merely  pointed  to  heretofore  unrecognized  problems  in 
the  very  limitations  of  intelligence  measurement.  Other 
factors  such  as  Industry,  loyalty,  honest;/,  tact, 
sympathy  and  cheerfulness  play  an  equally  prominent  part 
in  human  life.  Intelligance  by  itself  is  not  enough. 

(1)  Haggerty,  M.E.-  'Recent  Developments  in  Measuring 
Human  Capacities'.  Journal  Education  Research 
April  1921  pp.  241-253 
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At  this  same  time,  1919,  as  if  in  answer  to  the 
above  need.  Game  the  beginnings  of  objective  measure- 
ment of  non-intellectual  traits  in  the  shape  of 
Dr,  June  Downey’s  (1)  "A  Tentative  Scale  for  the 
Measurement  of  the  Volitional  Pattern" . 

Since  1921  the  emphasis  has  been  on  the  measure- 
ment of  character  and  personality  traits.  According 
to  Symonds  (2),  the  development  followed  roughly 
eight  types  of  effort.  These  eight  classes  are: 

A.  Habit  scales  of  which  the  Upton-Chassell 
(3)  "Scale  for  Measuring  the  Importance  of  G-ood 
Citizenship"  is  a type.  This  is  a scale  of  twenty-five 
qualities  described  in  concrete  terms  of  specific  habits. 
A quantitative  evaluation  of  each  item  is  provided  in 
the  total  score  of  one  thousand  points.  Several  judges 
assigned  values  to  the  descriptive  statements  on  the 
basis  of  relative  importance.  For  example: 

The  Good  Citizen: 

Stands  for  Fair  Play 

9.  Stands  for  fairness  in  games  or  arguments. 

(1)  Downey,  June -University  of  Wyoming  Bulletin  #16 

pp  1-40 

(2)  Symonds,  Percival  M.-"The  Present  Status  of  Character 

Measurement".  Journal  of  Educational  Psychology 
Vol . 15  pp.  484-498 

(3)  Upton,  S.H.  and  Chassell,  C.F.-"A  Scale  for  Measuring 

Habits  of  Good  Citizenship" -Teachers  College  Record 

1919 
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9.  Protests  against  anyone’s  taking  advantage 
of  the  weak,  stammerers,  cripples,  or  other 
unfortunate  persons. 

8,  Defends  absent  persons  who  are  unjustly  attacked. 

7.  Does  not  let  another  pupil  make  wrong  use  of 
his  work,  such  as  copying  from  his  examination 
or  home  work  papers . 

7.  Claims  no  more  than  a fair  share  of  his 

attention,  expecially  in  the  recitation  period. 

6.  Does  not  expect  special  favors  on  privilege's. 

The  observer  checks  the  habits  which 
are  characteristic  of  the  subject  and  computes  the  score. 

B.  Character  or  Personality  Scales  out  of 
which  grew  the  man- to -man  comparison  idea  and  the  graphic 
rating  scale.  Usually  this  is  a long  list  of  qualities 

or  attributes  which  the  rator  uses  in  judging  an  individual. 

C.  Self-assurance  or  overstatement  tests  used 
by  Voelker  (1)  . A blank  of  questions  such  as  the  follow- 
ing  is  prepared. 

1.  Do  you  know  how  to  write  any  number 
up  to  ten  million? 

2.  Do  you  know  the  name  of  the  capital 
of  each  state  in  the  Union? 

(1)  Voelker,  Paul  F .-'’Function  of  Ideals  in  Social 

Education ’-Teachers  College  Contribution  to  Education” 

#112 


I 


. 


-22- 


i 


3.  Do  you  know  the  names  of  the 
presidents  of  the  United  States  from  v/ashington  to 
Wilson? 

The  individual  who  answers  "no;i  marks  zero 
after  the  question,  the  one  who  answers  '’yes11  1 gives 
himself  a grade  of  ten.  The  score  for  the  whole  list 
is  computed  and  a prize  awarded  for  the  highest  score. 

A quiz  test  such  as  the  following  is  then 
given  and  the  replies  are  compared  with  the  statements 
given  in  the  above: 

1.  Give  the  capital  of  Utah. 

2.  Write  six  hundred  seventy  thousand 
forty-five,  and  eight  thousandths: 

3.  Name  the  third  President  of  the 

United  States . 

A score  of  1 is  given  for  each  correct  answer 
as  well  as  for  each  failure  in  the  quiz  test  providing 
the  answer  to  the  first  section  was  no. 

D#  Square  and  Circle  Test,  also  used  by 

Voelker . 

1.  Fifteen  toothpicks  are  placed  on 
the  table  so  as  to  form  five  equal  squares,  such  as: 
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Remove  three  toothpicks  so  as  to  leave  three  squares 
only.  A copy  of  this  diagram  is  given  and  the  subject 
is  instructed  to  accept  no  help  but  to  solve  it  himself. 

The  second  examiner  opens  a box  of  Gilbert 
puzzles  and  says: 

"I  have  some  puzzles  here  for  you.  Did  the 
previous  examiner  give  you  any  puzzles?  Gould  you  do 
them?  what  were  they?  These  are  easy.  Shall  I show 
you?"  The  subject’s  replies  are  carefully  recorded. 

The  purpose  of  this  test  is  to  discover  whether 
or  not  the  subject  can  be  trusted  to  refuse  help  in 
the  solution  of  a puzzle  which  he  has  been  instructed 
to  try  to  solve  independently. 

The  subjects  who  accept  help  are  scored  zero. 
Those  who  refuse  help  are  scored  ten.  Those  who 
partially  yield  are  scored  on  the  amount  of  yielding. 

II.  The  circle  test.  Each  subject  is 
handed  a piece  of  cardboard  12”  by  12”  on  which  are 
located  five  circles  5/8”  in  diameter  arranged  as  an 
imaginary  equilateral  pentagon. 
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The  subject  is  instructed  to  place  a pencil 
mark  in  each  circle,  with  his  eyes  closed,  as  his  hand 
sweeps  around  the  circumference  of  the  pentagon.  If 
he  places  a mark  in  each  circle  the  first  time  around, 
he  marks  on  a card,  ''first  trial  correct.  If  he  fails, 
he  writes  "first  trial  wrong."  Five  trials  are  given 
and  the  individual  reporting  the  highest  number  of 
successes  is  rewarded. 

The  feat  is  practically  impossible  of  accomplish- 
ment, Each  report  of  one  or  more  successes  is  scored 
zero  anu  eacn  report:  ox  all  1 allures  is  scored  te... 

ill.  Paraffin  Completion  Test,  also  used  by 
Voelker.  This  test  is  prepared  on  a four  page  folder. 
Page  one  contains  the  completion  exercise,  page  four 
contains  the  complete  exercise,  page  three  is  coated 
with  paraffin.  For  example: 

Page  1. 

1,  Boys  and soon  become 

and  women. 

2.  The  are  often  more  contented 

_the  hich. 

Page  4. 

1.  uoys  ana  gj.rls  soon  become  men  and 


women , 


2.  The  poor  are  often  more  contented 


than  the  rich 
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The  student  is  instructed  to  fill  one  word 
in  each  blank  space.  Page  four  is  folded  back  and  not 
seen.  After  the  test  is  completed,  the  paper  is  folded 
so  that  page  1 and  page  4 can  be  both  seen  at  the  same 
time  and  each  student  is  asked  to  score  his  own  paper. 

The  teacher  leaves  the  room  and  opportunity  is  given  to 
cheat.  Words  added  during  the  correcting  process  do  not 
appear  on  the  paraffin  which  holds  the  record  of  the 
first  attempt  to  fill  in  the  vacant  spaces.  Score  zero 
if  subject  cheated,  ten  if  he  did  not  cheat. 

F.  Speed  of  Decision  Test,  used  by  Downey  (1). 
This  is  a list  of  thirty  opposites  such  as  : 


careless 

cautious 

unambitious 

unselfish 

tardy 


1.  careful 

2.  daring 

3.  ambitious 

4.  selfish 
5 • punctual 

Subject  is  asked  to  draw  a line  under  the  word 
in  each  pair  which  more  nearly  describes  himself. 

Pairs  taken  in  order,  hone  to  be  skipped.  Time  limit 
45  seconds. 

G.  Questionnaire,  which  is  the  oldest  and 
most  direct  method,  and  has  a high  degree  of  subjectivity, 


(1)  Downey,  June  - "Downey  Will-Temperament  Test"  - World 
Book  Go.,  1923  - Yonkers-on- the-Hudson. 
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This  is  a long  list  of  questions.  Inferences  are  made 
from  the.  answers.  Value  questioned. 

H,  Tests  of  Judgments  of  moral  traits,  or 
ethical  discrimination  tests  ouch  as  Koh’s  (l)  ’’Ethical 
Discrimination  Test.  ' This  is  a test  designed  to 
measure  significant  ethical  knowledge  and  ability  to 
make  ethical  and  moral  judgments.  Six  types  of  response 
are  required  of  the  subject, 

a.  Social  Relations 

What  would  you  do  when  a playmate 
hits  you  without  meaning  to?  If 
you  found  that  a man  had  just  hung 
himself? 

b.  Moral  Judgment 

'which  is  worse?  lighting,  killing, 
hurting,  quarreling,  hating. 

c . Meaning  of  Proverbs 

Don’t  count  your  chickens  before 
they  are  hatched  means 

d . Definitions  of  Moral  Terms 

Good  means  dirty,  right,  break  or 
bad. 

e.  Evaluation  of  Offenses 


(1)  Mohs,  G.  S.  - "Ethical  Discrimination  Test"  - 

C.  H.  Stoelting  and  Co, -424  II.  Homan  .we . , Chicago 
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For  such  offenses  as  bigamy  one 
should  be  praised,  ignored,  scolded, 
put  in  jail,  put  in  prison,  killed, 
f . Moral  Problems 

You  should  not  throw  hot  water  on 
a cat  because;  you  only  waste  water, 
hot  v/ater  hurts  the  cat,  cats  bathe 
in  cold  v/ater. 

For  the  most  part  this  is  a multiple  choice 
test,  but  there  is  opportunity  also  for  essay  response. 

The  most  significant  recent  contributions  to  this 
developing  movement  have  been  made  in  the  measurement 
of  character  by  the  Character  Education  Inquiry  (1),  in 
the  measurement  of  attitude  by  Thur stone  and  Chave  (2), 
and  in  the  measurement  of  certain  aspects  of  faith  in 
God  by  Donnelly  (3) . 

(1)  Hartshone  and  .ay- "Studies  in  Deceit”-Mc.  Milan  1928 
Hartshone  and  May-" Studies  in  Service  and  Self  Control 

McMillan  1929 

Hartshone  and  May-'1 Studies  in  the  Organization  of 

Character-McMillan  1930 

(2)  Thur  stone  and  Chave- "The  Measurement  of  Attitude" - 

University  of  Chicago  Monograph  1929 

(3)  Donnelly,  H.I .-"Measuring  Certain  Aspects  of  Faith 

in  God  as  Found  in  Boys  and  Girls  15-16,  and  17 
years  of  Age" -Westminister  Press  1931 


-28- 


B.  LIE ASUREI.CEN T III  THE  FIELD  OF  RELIGIOUS  EDUCATION 

AT  PRESENT. 

Perhaps  we  should  say  "measuring  instruments  in 
the  field  at  present  which  are  of  interest  to  religious 
educators/'  It  becomes  immediately  evident  that  in  the 
measurement  of  character  habits  or  personal  qualities, 
the  efforts  of  so-called  secular  educators  and  religious 
educators  overlap.  Some  tests  have  been  developed  by 
agencies  which  regard  their  function  as  distinctly 
secular,  and  other  tests  have  been  developed  by  workers 
in  the  religious  field,  which  are  useable  in  either 
field.  In  the  following  paragraphs  our  major  considera- 
tion will  be  with  the  instruments  of  measurement  which 
can  be  used  in  the  religious  field  regardless  of  the 
authorship  or  of  the  source  from  which  they  came. 

It  is  next  to  impossible  to  list  all  of  the  instru- 
ments of  measurement  which  are  of  interest  to  Religious 
Educators,  partly  because  of  the  wide  variety  of  sources 
from  which  experimentation  in  this  field  comes,  and  part 
ly  because  much  that  is  presented  is  inferior  to  other 
similar  efforts.  Hence  the  tabulation  of  tests,  in 
rather  arbitrary  classifications  in  the  following  pages, 
is  not  in  any  way  complete,  but  is,  we  hope,  in  a 
measure  comprehensive. 
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1.  Biblical  Knowledge  Tests. 

A.  V/hitley  (1)  Biblical  Knowledge  Tests,  is 
published  in  two  forms.  Form  A 43  and  B 21,  and  is 
a non-critical  multiple  choice  test  of  Biblical  in- 
formation. To  be  used  with  ten  year  olds  and  older. 

B.  Church  School  Examination  Alpha  (2)  is  a 
test  of  seventy-five  multiple  choice  questions  in 
three  sections.  The  first  section  deals  with  Old 
Testament  information,  the  second  section  with  New 
Testament  information  and  the  third  section  with 
Ethical  discrimination.  To  be  used  with  ten  year 
olds  and  older. 

G.  Laycock  Test  of  Biblical  Information  (3)  is 
a test  designed  to  test  Biblical  facts.  This  also 
is  a multiple  choice  test,  to  be  used  with  ages  twelve 
to  sixteen. 

These  three  tests  are  improvements  upon  Giles 
Sunday -Examination  A (4)  which  was  a Biblical  information 
true-false  test. 

(1)  M . T.  Whitley,  Teachers’  College,  Columbia  University, 

New  York. 

(2)  Published  by  Vi.  L.  Han son-^oston  University  School  of 

Religious  Education,  Boston,  Mass. 

(3)  Published  by  S.  •£t.  Lay cock-University  of  Alberta  Book- 

store, Edmonton,  "lberta,  Canada. 


(4)  Now  out  of  print 


K 
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* 
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The  multiple  choice  method  is  an  improvement  on  the 
true-false  plan.  They  attempt  to  measure  nothing  but 
Biblical  Information,  although  interesting  correlations 
have  been  worked  out  between  the  three  divisions  of  the 
Church  School  Examination  -ilpha,  from  which  inferences 
concerning  the  relation  of  Biblical  information  to 
ethical  discrimination  have  been  made.  However,  these 
inferences  have  little  value,  due  to  the  difficulty  of 
isolating  such  factors  as  school  life,  and  home  train- 
ing which  also  operate  in  the  forming  of  ability  in 
ethical  discrimination. 

2.  Tests  of  Religious  Ideas. 

A.  Multiple-Choice  Test  of  Religiotis  Ideas  (1)  . 
An  effort  to  discover  the  religious  ideas  of  people. 

The  procedure  is  to  check  the  five  best  answers  out  of 
a possible  list  of  fifteen  for  ten  questions.  Can  be 
used  with  all  persons  who  can  read. 

B,  "A  Scale  for  Measuring  Certain  Aspects  of 
Faith  in  God  as  Found  in  Boys  and  Girls,  Fifteen, 

Sixteen  and  Seventeen  years  of  Age'1  (2).  This  is  a 
four  part  test.  Part  1 is  a multiple-choice  vocabu- 
lary test.  Part  2 is  a general  questionnaire. 

Part  3 is  a questionnaire  in  which  the  subject  is 

(1)  Indiana  Survey  of  Religious  Education-Doran  1918 

Vol • 3-pp  430-450 

(2)  Donelly,  H,  I*-  A Thesis  in  Education. - 

Westminister  Press  1931--pp  95-102 
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asked  to  check  all  of  the  list  of  fifty  statements 
which  indicate  his  position  in  answer  to  the  ques- 
tion, 11  How  touch  Do  You  Trust  God",  Part  4 is  a 
five  point  rating  scale  on  which  the  subject  rates 
his  feeling  regarding  forty-one  questions  of  belief 
about  God. 

G.  Union  Test  of  Religious  Ideas  (1).  The 
purpose  of  this  test  is  to  measure  certain  intellec- 
tual concepts.  A yes  or  no  response  to  a series 
of  religious  questions,  and  a completion  exercise 
on  the  story  of  the  Bible,  content  and  relationships, 
is  the  procedure  followed. 

3.  Ethical  Discrimination  Tests. 

A.  Fernald  Ethical  Discrimination  Test 

No.  36035  (2).  The  subject  ranks  or  arranges  a 

series  of  offenses  from  the  least  to  greatest  in 
order  of  gravity.  The  purpose  is  to  ;et  an  insight 
into  mentality  and  the  degree  of  responsibility  of 
the  subject. 

B.  Fernald  Ethical  Perception  Test  No.  27105 
(3) . This  test  is  designed  merely  to  give  some 
insight  of  a person's  intelligence  in  the  matter  of 

(1)  Published  by  Dept,  of  Religious  Education- 

Union  Theological  Seminary,  3041  ^roadway. 

New  York. 

(2)  Published  by  C.H.  Stoelting  h Go. -424  N. Homan  Ave 

Chicago 


(3) 


Published  by  G.K.  Stoelting  & Co. -424  N. Homan  Ave 
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right  and  wrong,  realizing  that  knowledge  is 
little  safeguard  against  wrong  doing.  Ten  ques- 
tions, seven  to  be  answered  yes  or  no,  the  last 
three  by  solving  problems. 

G.  Koh's  Ethical  Discrimination  Test  (1). 

The  test  is  designed  to  measure  ethical  knowledge, 
opinions,  judgments  and  interpretations.  It  is  a 
mixture  of  multiple  choice,  problem  solution,  and 
interpretation  of  proverbs,  methods. 

D.  Union  Test  of  Ethical  Judgment  (2) . This 
test  is  designed  to  measure  ethical  standards  with 
regard  to  current  problems  of  life  relationships 
such  as  economic  justice,  gambling,  questionable 
recreation,  etc.  The  method  is  a yes  or  no  res- 
ponse to  questionnaire  and  three  point  rating  of 
excellent, --fair, --poor  type, 

4.  Attitude  Tests. 

A.  Test  of  Racial  Attitudes  (3) . The  purpose  is  to 
measure  attitude  toward  people  of  other  races.  Subject 
chooses  one  of  the  following 

(1)  Published  by  C.H.  Stoelting  & Co, -424  IT.  Homan  Ave- 

Ghicago 

(2)  Published  by  Dept,  of  Religious  Education-Union 

Theological  Seminary,  3041  Broadway,  Hew  York 

(3)  Published  by  Goodwin  B.  Watson- Teachers  College- 

Go  lumbi  a 
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words:  All,  Most,  Many,  Few,  No,  to  complete  a 

problem  statement  such  as:  11  Jews  will  cheat  you 

if  they  can1 2 3’  . Thirty- six  elements  ranging  from 
conservative  to  radical  in  idea. 

3.  Hart  Test  of  Social  attitudes  and 
Interests  (1).  The  purpose  is  to  reveal  dominant 
likes  and  dislikes  by  marking  several  activities 
plus  or  minus  for  like  or  dislike. 

G.  Thurstone  and  Chave’s  battery  of  attitude 
scales  (2)  four  scales  for  measuring  ’’Attitude 
toward  God'1',  ’’Attitude  Toward  Prohibition”, 

’’Attitude  Toward  ’war”,  and  Attitude  Toward  the 
Church”.  Given  a list  of  statements  the  subject 
is  asked  to  check  the  statements  with  which  he 
agrees,  double  check  the  statements  about  which 
he  feels  most  strongly  and  place  a cross  before 
the  statements  with  which  he  disagrees. 

5.  Character  Tests. 

A.  ^Battery  of  Tests  developed  by  The 
Character  education  Inquiry  (3). 

*-'(All  tests  in  this  battery  here  listed  are  published 
by  the  Association  Press-New  York) 

(1)  Published  by  Iowa  Child  welfare  Research  Station- 

University  of  Iowa-Iowa  City-Iowa. 

(2)  Published  by  University  of  Chicago  Press-Chica  go . 

(3)  Harts^orne  and  May-” studies  in  the  Organization 

of  Character” -McMillan  1930-pp  366-367. 
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(1)  ‘j-'he  I B R Arithmetic,  Word  Knowledge  and 
Spelling  Test  attempt  to  measure  honesty  in  relation 
to  school  work. 

(2)  The  S A Test  measures  the  tendency  to  mis- 
represent customary  behavior  for  social  approval. 

(3)  Tests  of  classroom  cooperation.  Measures 
work  done  for  gain  of  self  or  gain  of  class,  work 
sacrificed  for  sake  of  class. 

Thus  far,  in  our  consideration  of  measuring  instru- 
ments in  the  field  of  Religious  Education,  we  have  been 
concerned,  primarily  with  the  test  type.  Biblical 
information  tests,  tests  of  religious  ideas,  tests  of 
ethical  discrimination,  and  attitude  tests  and  scales 
are  primarily  concerned  with  the  measurement  of  know- 
ledge. Character  tests  are  concerned  pri: madly  with 
measuring  the  responses  to  controlled  labratory 
situations . 

The  relationship  between  knowing  and  doing  is  not 
measured  in  the  above  instruments  and  as  bitty  and  Lehnan 
(1)  pointed  out,  "serious  temptations  are  seldom  placed 
before  thesubject  in  laboratory  situations",  P.412. 
Another  question  we  immediately  ask  is  whether  or  not  we 
can  regard  the  response  to  a laboratory  situation  as  an 
indication  of  what  the  response  would  be  in  a kindred 
life  situation. 


(1)  Psychological  Review  1927 
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These  and  many  similar  problems  Inevitably  raise 
tbe  or e s t i or.  poliov  or  onocedure.  Should  we  be 

primarily  concerned  with  evaluating  responses  in  a 
few  controlled  situations,  and  should  we  be  primarily 
concerned,  with  knowledge,  opinions,  religious  ideas? 
Should  we  not  rather  be  concerned  with  observing  and 
evaluatint  many  responses  to  many  and  varied  life 
situations  if  we  wish  to  discover  conduct  and  character 
habits  of  the  subject? 

This  second  suggested  approach  is  properly 
identified  with  rating  scales  and  the  process  of  rating, 
consideration  of  which  will  be  given  in  the  following 


pages 


Chapter  III 


The  Rating  Scale . 
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..  THE  THEORY  OF  THE  RATING  SCALE. 

Thus  far  we  have  concerned  ourselves  primarily 
with  the  need  for  measurement,  what  ought  to  he 
measured,  and  a classification  of  phenomena  which  is 
now,  in  a small  way,  being  measured.  Yet hods  of 
measurement,  and  basic  differences,  in  instruments 
need  now  to  be  considered. 

Width,  heighth,  thickness,  depth,  and  volume  can 
be  measured  objectively,  by  means  of  an  objective  in- 
strument such  as  a rule  or  tape  measure.  Thus  we  say 
a man  is  six  feet  two  inches  in  height  and  that  another 
man  is  four  inches  shorter.  The  measurement  is  purely 
objective,  due  to  the  universal  acceptance  of  the  inch 
as  the' unit  of  measurement. 

The  handwriting  of  a pupil  is  measured  by  compar- 
ing it  to  a universally  accepted  sample  of  perfect 
handwriting.  The  measurement  is  still  objective,  but 
when  we  wish  to  know  how  much  poorer  it  is  than  the 
sample,  the  element  of  subjectivity  enters  with  the 
necessity  of  personal  judgment. 

If  we  turn  our  attention  now  to  the  processes  of 
learning  through  which  the  pupil  went  in  order  to  be 
able  to  write,  and  try  to  discover  the  degree  of 
patience,  interest,  and  initiative  which  was  present 
in  the  learning  process  we  find  that  this  data  does 
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not  lend  itself  to  objective  treatment,  and  if  it  is 
to  be  measured  at  all,  must  be  measured  by  the  highly 
subjective  process  of  judging. 

Thus  we  have  the  distinction  between  objective 
and  subjective  types  of  measurement.  T tere  is  no 
question  as  to  the  desirability  of  objective  measure- 
ment as  over  against  subjective  measurement,  but  most 
psychological  phenomena  can  only  oe  measured  by  the 
so-called  subjective  method.  The  first  stride  toward 
improvement,  however,  is  standardizing  the  methods 
of  judging. 

The  rating  scale  is  the  instrument  or  medium  through 
which  we  do  our  judging,  and  is  built  on  certain  basic 
assumptions  or  theories. 

1.  The  first  basic  assumption  is  that  character 
habits  and  personal  qualities  or  characteristics  exist 
and  can  be  measured.  Every  attempt  at  rating  is  contin- 
gent upon  this  basic  assumption.  Human  beings  have  been 
using  comparisons  ever  since  they  have  been  uman 
beings.  ''More  beautiful",  'less  strong",  "less  happy", 
"more  diligent",  etc.,  are  phrases  which  are  so  much  a 
part  of  human  vocabulary  and  life  that  the  existence 
of  qualities  can  hardly  be  denied,  and  yet  we  cannot 
say  that  they  exist  in  the  abstract. 

Dealing  with  the  fact  that  failure  to  get  results 
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in  character  education  is  based  on  the  theory  of 
transfer  which  modern  educational  psychology  denies, 
Hartshorne  and  lay  (l)  point  out;  "In  our  studies  in 
conduct  we  have  accur.iulated  a large  amount  of  data 
which  will  enable  us  to  test  scientifically  the  truth 
or  falsity  of  this  theory.  If,  for  example,  honesty 
is  a unified  character  trait,  and  if  all  children 
either  hav  it  or  do  not  have  it,  then  we  would  ex- 
pect to  find  children  who  are  honest  in  one  situation, 
to  be  honest  in  all  other  situations,  and,  vice  versa 
to  find  dishonest  children  to  be  deceptive  in  all 
situations.  /hat  we  actually  observe  is  that  the 
honest^/  or  dishonesty  of  a chill  in  one  situation  is 
related  to  his  honesty  or  dishonesty  in  another  situa- 
tion mainly  to  the  degree  that  the  situations  have 
factors  in  common.  -----  Thus  we  see  very  little 
evidence  of  unified  character  traits.  - - - - Honesty 
is  simply  a.  name  to  describe  conduct  as  observed  in 
specific  situations.  The  doctrine  of  specificity  as 
shown  by  the  facts  cited  above,  maintains  that  a child's 


(l)  Hartshorne  and  lay  "Summary  of  the  .ork  of  the 
Character  Education  Inquiry"  Religious  . .ducat ion , 
7ol.  5 P.  754 
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conduct  in  any  situation  is  determined  more  by  the 
circumstances  that  attend  the  situation  than  by  any 
mysterious  entity  residing  within  the  child.  1 Thus 
the  child  develops  many  specific  habits  of  being 
honest,  and  our  study  of  character  becomes  the  process 
of  observing  and  judging  the  presence  or  absence  and 
the  degree  of  presence  or  absence  of  certain  well 
defined  types  of  ehavior. 

Thus  if  we  wish  to  discover  how  trustworthy  a 
child  is  we  proceed  by  one  of  two  methods,  we  either 
compute  the  scores  on  tests  such  as  Voelker's  self 
assurance  or  overstatement  test,  square  and  circle  test, 
paraffin  completion  test  (described  on  preceding  pages) 
or  we  build  a scale  of  many  specific  responses  to 
life  situations  si  lilar  to  the  following  and  indicate 
a position  on  the  line  above  which  in  our  judgment 
corresponds  to  the  degree  of  trustworthiness  which 
the  child  indicates. 

1.  Does  he  take  advantage  of  teacher’s 
absence  from  the  room  to  cause  disturbance? 


Always 
acts 
same  as 
though 
teacher 
were 
in  the 
room . 


Enjoys 
fun 
but 
seldom 
parti- 
cipates . 


Joins 

in 

distur- 

bance 

on 

some 

occasions 


Joins  Never 

heartily  misses 
in  dis-  chance 
turbances  to  take 
started  advantage 
by  some  of  the 
one  else,  teacher’s 
absences 
to  start  a 
disturb  a .ce . 
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2.  Does  he  do  his  own  work  or  does  he 
depend  on  others? 


Always 

Toes 

Does 

Does  own 

Always 

does 

own 

own 

work  on 

depends 

own 

work , 

work 

occasion 

on  others. 

work , 

but 

but 

but  would 

Copies 

never 

copies 

conies 

rather  copy 

whenever 

copies . 

rather 

for  the 

than  work. 

he  gets 

than 

sake  of 

a chance . 

fail. 

better 

marks . 

In  the  one  method  we  create  specific  controlled 
situations  in  which  the  responses  are  scored.  In 
the  other  we  indicate  our  judgment  of  the  decree  of 
the  presence  or  absence  of  desirable  character  habits 
from  the  observation  of  many  life  situa.tirns.  The 
one  is  evaluation  of  response  to  created  or  controll- 
ed stimuli.  The  other  is  evaluation  of  many  typical 
reactions  to  natural,  uncontrolled  stimuli,  or  life 
situations . 

However,  it  is  evident  that  many  of  the  basic 
assumptions  underlying  rating  are  also  applicable  to 
testing . 

2.  These  qualities  or  habits  can  be  so 
defined  as  to  provide  a working  basis  for  discovery 
of  their  oresence  or  absence  in  many  given  situations 
and  the  decree  .in  which  they  are  present  or  absent. 

A problem  presents  itself.  It  is  usually  stated  in 
the  form  of  criticism  in  two  ways. 


. 


. 
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First,  in  the  question  of  the  overlapping  of 
qualities.  Secondly,  according  to  Chave  (1) 

the  terms  used  to  describe  social 

and  religious  attitudes,  tendencies,  and  qualities  of 
activities,  and  accomplishments  are  not  uniformly 
interpreted."  Life  is  not  lived  in  compartments, 
hut  as  a unit.  Hence  when  we  say  a boy  is  truthful 
and  honest  in  a given  situation  we  immediately  face 
the  question,  where  does  honesty  leave  off  and  where 
does  truthfulness  commence?  An  overlapping  is 
evident,  but  is  the  overlapping  in  qualities  or 
in  titles  we  have  attached  to  one  quality?  If  a 
boy  is  truthful  he  is  also  honest.  ..hat  is  the 
difference  if  we  are  measuring  the  same  quality  and 
calling  it  honesty  in  one  situation  and  truthfulness 
in  another?  Are  we  not  more  anxious  to  discover  the 
presence  or  absence  of  the  quality  than  the  title? 
Suppose  we  wish  to  discover  whether  or  not  a boy 
does  his  own  work  in  school.  We  build  a questionnaire 
and  have  him  check  himself  or  we  observe  his  conduct 
at  school.  We  discover  that  in  some  situations  he 
relies  on  himself,  while  in  others  he  copies. 

( 1)  Chave,  E.  J.  - 'Supervision  of  Religious  Education" 

P.  313.  University  of  Chicago 
Press  1931. 
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We  say  he  is  not  perfectly  honest,  nor  is  he  perfectly 
dishonest  and  assign  him  a position  on  a scale  or 
give  a standing  in  comparison  to  others,  or  place  a 
numerical  value  after  his  name.  This  stands  for  the 
degree  of  the  quality  that  we  prefer  to  call  honesty. 
At  any  rate  we  have  measured  the  quality  or  habit* 

By  defining  the  type  of  quality  we  wish  to  measure  in 
carefully  selected  descriptive  terms  we  are  not 
necessarily  defining  honesty,  but  the  habit  or  quality 
we  wish  to  observe  and  placing  it  in  the  category  of 
honesty.  If  we  try  to  measure  honesty  in  a general 
way  we  are  immediately  conscious  of  "overlapping"  or 
lack  of  uniformity  in  interpretation  of  the  term, but 
if  we  are  careful  in  our  descriptive  definitions  of 
what  we  wish  to  measure,  the  problem  diminishes  and 
we  have  at  least  a working  basis  on  which  to  -proceed 
with  our  measurement. 

3.  The  third  basic  assumption  is  that  some 
qualities  or  habits  are  present  in  greater  degree 
in  the  activities  of  some  individuals  than  they  are 
in  others.  If  this  were  not  so  there  would  be  no 
need  for  rating.  There  would  be  no  persons  at  the 
extreme  ends  of  the  scale,  aid  therefore  there  would 
be  no  need  of  a scale.  Two  clerks  work  side  by  side 
in  an  office.  One  comes  to  work  with  clothes  pressed. 
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shoes  shined,  heir  coined,  clean  hands  and  nails  while 
another  comes  with  clothes  impressed,  hair  untidy,  shoes 
dusty,  hands  end  nails  unkempt.  One  clerk  places  his 
naners  reatlv  a warn  at  closin'  t?.me , the  other  tosses 
them  hurriedly  into  a drawer.  We  say  immediately  that 
one  s neater  than  the  other.  We  cannot  say,  however, 
that  one  is  neat  and  the  other  is  not,  because  there  are 
easily  recognizable  varying  degrees  of  neatness.  The  same 
observation  might  be  made  of  ambition,  friendliness, 
intelligence,  sympathy,  cooperativeness  and  similar 
qualities  or  characteristics.  This  leads  us  directly  to 
our  fourth  basic  assumpt ion,  which  is  implied  in  the  above 
illustration. 

4.  The  presence  or  absence  of  these  qualities  and 
the  de  ree  of  their  presence  or  absence  may  be  inferred 
from  behavior.  As  has  already  been  pointed  out,  character 
is  the  composite  of  many  specific  habits  of  being  honest, 
truthful,  etc.  It  has  also  veer  shown  that  the  relationship 
between  specific  ha  jits  of  being  honest,  etc.,  is  determined 
by  factors  operative  in  various  situations  which  are  similar 
or  common.  Thus  it  oecomes  evident  that  the  observation  of 
the  reactions  to  a few  situations  is  not  an  adequate  index 
of  a child’s  honesty. 

A boy  may  be  trustworthy  in  running  errands  and  handling 
money  for  his  mother.  He  may  never  cheat  in  school.  He 
may  tell  the  grocer  he  was  given  too  much  change.  At 
the  same  time  he  may  spend  part  of  the  money  given  him  as 


offering  for  Sunday  School  or  he  may  ride  on  an  out- 
of-date  transfer  on  the  street  car  if  he  can  get  by 
with  it. 

Observation  of  a few  of  this  bov's  activities 
and  the  rating  of  honestv  or  trustworthiness  will 
probably  nos  reveal  habits  and  practices  which  ou^ht  to 
be  observed  in  order  that  the  most  accurate  picture  of 
character  might  be  obtained. 

Thus  we  cannot  generalize  from  too  few  phases  of 
behavior.  Many  typ.es  of  activity  and  the  reactions  to 
many  different  situations  must  be  carefully  observed  if 
our  ratings  are  to  be  valid  estimates  of  that  which  we 
attempt  to  measure, 

5.  Fifthly,  it  is  possible  for  observers  to  dis- 
tinguish between  the  degrees  of  the  presence  or  absence  of 
a given  quality  or  habit.  Five  men  stand  in  a row  applying 
for  a position.  ’A*  is  punctilious  in  his  dress,  his  hair 
is  oiled  to  stay  in  place,  a flower  adorns  his  button  hole, 
his  clothes  are  pressed  with  krife-like  severity,  hands 
daintily  manicured- -almost  foppish  in  appearance.  TB!  is 
dressed  simply,  hair  combed,  clothes  pressed,  clean  hands, 
shoes  br'  shed  but  not  shined.  ’ C’sT  clothes  are  rather 
worn,  carefully  brushed,  hair  combed,  cleanly  shaven, 
hands  clean,  nails  unkempt.  ' D ’ has  clothes  of  good  quality. 
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unpressed,  hair  not  cobbed,  shoes  in  need  of  a shine, 
hands  and  nails  unkempt.  TE’  has  soiled  shirt,  tie 
knotted  carelessly,  unclean,  clothing  soiled  and 
unpressed,  shoes  badly  in  need  of  a shine.  ith  A, 

B,  G,  D,  and  E,  standing  together,  it  is  easy  to  infer 
which  of  the  five  is  neatest  and  least  neat.  It  is 
also  easy  to  place  B as  next  to  A and  D next  to  E with 
G in  the  middle.  It  Is  not  always  as  easy  as  this. 

Very  often  the  qualities  are  not  as  easily  discernible  and 
often  there  is  real  question  as  to  which  of  two  or 
more  individuals  should  be  placed  at  one  end  of  the 
scale  and  which  of  several  at  another,  with  still 
greater  question  about  those  in  between. 

6.  The  sixth  basic  assumption  is  that  the 
assigning  of  numerical  values  to  the  degree  of  the 
quality  which,  in  the  judgment  of  the  observer,  is 
apparent  or  the  assigning  of  the  degree  of  the  quality 
to  an  area  on  a linear  continuum,  makes  the  judgment 
more  concrete.  Rugg  (1)  in  this  application  of  the 
principle  of  man- to -man  comparison  to  a rating  scale 
for  high  school  students,  assigned  the  following 
numerical  values  to  each  of  the  five  groups  or  ranks 
of  students;  the  best  student  -58,  better  than  aver-,  e 

( ! ) Aug;/; , H.G.  - ^Rating  iale  for  H i ihool  ents1' 

P.  431  Journal  Educational  Psychology 
Vol . 12:  1921 
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30,  average-22,  poorer  than  average-14,  poorest 
student-6.  In  this  way  the  total  judgment  of  the 
pupil  is  facilitated.  Student  'A1  might  rank  6 
in  the-  first  quality,  33  in  the  second,  22  in  the 
third  and  so  on.  The  final  score  then  shows  more 
concretely  the  presence  or  absence  of  various 
qualities  and  the  degree  of  the  presence  or  absence 
of  the  desirable  and  undesirable  qualities  due  to 
the  universal  recognition  and  interpretation  of 
numerical -values . However  ive  (1)  points  out, 

the  use  of  numerical  values  must  be  used  with  cau- 
tion.  "For  the  sake  of  convenience  numerical 
indexes  are  used  to  describe  differences,  but  the 
mathematical  language  does  not  mean  that  exact 
measures  have  been  taken.  Measures  are  all  sub- 
jective estimates  and  rough  approximations,  find- 
ings being  interpreted  by  reference. to  the  scale 
aised.  Though  scores  on  a knowledge  test  may  be 
given  in  precise  numbers,  such  as  ? 4 or  96,  or 
a person's  position  on  an  attitude  scale  as  3.7, 
it  does  not  mean  that  v/e  have  as  exact  measure  of 
his  knowledge  or  attitude  as  the  mathematical 
symbols  seem  to  sug  -est,  All  we  have  are 
symbols  of  relative  position,  and  the  meaning  of 


(1) "Studies  in  Religious  Education" 

1931,  Page  130 


Cokesbury  Press 
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them  depends  upon  a thorough  understanding  of  the 
way  in  which  the  figures  have  been  obtained.  This 
is,  however,  the  same  situation  as  in  general 
education  when  we  state  a person’s  I.Q,.  as  140.  It 
means  the  person  has  a superior  intelligence  as  far 
as  the  test  given  has  been  able  to  measure  differences, 
but  the  inference  often  is  that  when  a person  has  been 
able  to  answer  a number  of  questions  in  an  approved  way 
that  he  has  thereby  revealed  his  native  mental  capacity. 
The  I.Q,.  may  be  a convenient  index,  but  it  is  by  no 
means  an  exact  measure  of  intelligence.  1 

7.  Seventhly,  by  carefully  defining  and 
thus  restricting  by  definition  the  types  of  behavior 
to  be  observed,  the  judgments  of  the  presence  or 
absence  of  a quality  and  the  degree  of  presence  or 
absence,  will  have  greater  validity.  A scale  is  con- 
structed to  measure  the  spirit  of  cooperativeness  of 
kindergarten  children.  After  several  independent 
ratings  by  several  competent  judges,  correlations 
between  judgments  of  different  teachers  and  different 
judgments  of  the  same  teacher  are  taken  and  they  show 
a coefficient  of  correlation  which  is  theoretically 
perfect.  Have  they  measured  the  cooperative  spirit  of  the 
child  and  will  they  say  this  child  is  very  cooperative? 

The  judgment  of  the  cooperative  spirit  of  the  child  is 
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valid  for  the  school  room  and  other  situations  in  which 
there  are  factors  in  common  with  the  school  room 
situation  and  not  for  the  general  spirit  of  cooperative- 
ness . 

(The  above  seven  items  are  the  basic  theories  or 
assumptions  underlying  rating  as  a method  of  measurement. 
This  last  theory  has  to  deal  with  why  we  are  concerned 
with  rating  as  measurement.) 

8 . In  the  last  place,  some  qualities  or 
habits  on  the  basis  of  race  experience,  social  opinion, 
and  religious  belief,  are  considered  ighly  desirable 
and  can  be  cultivated,  w ile  others  are  undesirable 
and  can  be  sublimated.  Jealousy,  envy,  self  is. ■•mess, 
unt ru s two r thine s s , and  similar  characteristics  appear 
oftentimes  and  are  recognized  to  be  distinctly  anti- 
social, while,  on  the  other  hand,  punctuality,  honesty, 
altruism,  and  similar  qualities  are  regarded  as  highly 
desirable.  The  concept  of  education  as  a rnocess  of 
producing  changes  is  without  value  unless  we  recognize 
desirable  qualities  or  ends  and  thus  give  direction  to 
the  process.  To  what  extent  are  desirable  qualities 
present  at  a g:  wen  time  in  the  process?  Is  the 
procedure  which  has  been  selected,  achieving  the 
desired  objectives?  In  what  way  can  we  discover  answers 
to  the  above  and  similar  questions?  We  must  have  so  ;e  way 
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of  collecting  data  to  serve  as  the  basis  of  judgment 
and  we  turn  to  the  rating  scale  as  the  instrument  which 
is  best  suited  to  this  pur  ose.  However,  the  question 
arises;  Gan  we  not  discover  the  answers  to  the  above 
and  similar  questions  by  the  use  of  tests? 

The  most  careful  and  comprehensive  testin  pro  ram 
to  date  has  been  conducted  by  the  Character  Education 
Inquiry  which  tabulates  its  findings  in  three  volumes  (1) . 
Almost  eighty  tests  were  used  as  the  basis  for  the 
measurement  of  knowledge,  attitude,  intelligence,  conduct, 
background,  and  social  adjustment.  On  the  basis  of  this 
very  extensive  study  the  authors  came  to  the  following 
conclusions  (2.). 

1.  ''Character  cannot  be  measured  adequately  by 
any  single  or  simple  test  that  canbe  administered  in 
one  hour  and  scored  in  ten  minutes. 

2.  Ho  algebraic  summation  or  average  of  any  set 
of  test  scores,  no  matter  how  extended  or  elaborate, 

w ill  give  a true  index  to  character. 

(1)  Hartshorne  and  May  - Studies  in  Deceit  - McMillan  1928 

1 11  - Studies  in  Service  and  Self- 

Control  - McMillan  1929 

" 11  " - Studies  in  the  Organization  of 

Character  - McMillan  1930 

(2)  Hartshorne  and  May  - "Summary  of  the  V/or^  of  rhe 

Character  Education  Inquiry"  - 
Religious  Education  Vol.  5,  P.  619 
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3.  If  a large  number  of  samples  of  conduct, 
icnov/ledge,  attitude,  intelligence,  background,  and 
social  adjustment  are  taken,  and  if  the  general 
algebraic  level  for  each  individual  is  determined  and 
at  he  same  time  if  the  variability  of  each  individual’s 
scores  around  his  ovyn  mean  is  computed,  a combination 
of  these  two  values  will  indeed  yield  an  index  or  score 
of  character.'1 

These  conclusions  point  to  the  fact  that  single 
tests  or  few  tests  do  not  provide  an  index  to  character, 
and  that  the  only  valid  index  to  character  is  secured 
by  the  combination  of  many  and  varied  types  of  tests. 
Fur thermo re,  this  experiment  required  approximately 
thirty  hours  of  time  from  each  student  tested. 

Thus,  we  see  that  a valid  testing  program  Is 
Impractical  because:  in  the  f rst  place,  it  limits  the 
use  of  this  method  to  a very  few  trained  experts  in 
the  field  , and  in  the  second  place,  the  amount  of  time 
required  makes  it  impossible  of  use  in  the  field  of 
religious  education,  ./here,  for  the  present  at  least, 
the  time  spent  is  only  approximately  fifty-two  hours 
per  year. 

Hart shorn e and  May  (1)  further  point  out  that 
-,,An  Interesting  practical  implication  of  all  this  for 
character  testing  is  that  since  it  is  probably  easier 

(1)  Hartshorne  and  ay  - Religious  Education 

Vol . 5 --  Page  617 
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to  secure  a series  of  valid  judgments  concerning 
attitudes  and  conduct  tendencies  than  it  is  to 
secure  an  equally  valid  series  of  objective  tests, 
and  since  the  theoretical  correlation  between  the 
two  is  almost  perfect,  teachers  and  others  interested 
in  securing  a character  score  on  children  might 
very  -veil  look  forward  to  doing  so  by  securing  a large 
number  of  reliable  o servations  and  ratings. 

In  the  second  place,  assuming  that  the  attempts  of 
the  Character  Education  Inquiry  have  completely 
measured  character  as  far  as  honesty,  service,  and 
self-control  are  concerned,  there  are  still  a large 
number  of  intangible  qualities  such  as  tolerance, 
cooperativeness,  resourcefulness,  courage,  etc.,  for 
which  there  are  as  yet  no  valid,  objective  tests. 

Thus,  because  of  problems  arising  in  the  use  of 
tests,  and  because  of  the  fact  that  there  are  not  as 
yet  valid  tests  with  which  to  measure  all  of  the  qualities 
which  should  be  measured,  the  rating  scale,  which  is  an 
instrument  to  be  used  in  the  observation  of  an 
individual  in  many  situations  and  to  record  the 
mental  summations  of  the  rator  of  many  subjective 
judgments  of  behavior  of  the  individual  o.  served, 
it  is  the  most  usable  instrument  available. 

B.  TYPES  0?  RATING  SCALES . 

The  basis  for  a consideration  of  types  of  rating 
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scales  must  be  more  or  less  arbitrarily  chosen.  Barr 
and  Burton  (1)  list  two  types  of  rating  scales,  the 
brief  or  compact  rating  scale  and  tie  elaborate  scale. 

This  distinction  is  evidently  made  on  the  basis  of 
useability,  and  s hardly  the  basis  of  a discussion  of 
types  of  rating  scales. 

or  is  the  difference  of  methods  in  rating  a 
satisfactory  basis  or  a discussion  of  types  of  scales. 
Preyd  (2)  lists  eleven  distinct  nethods  of  ratings. 
Oftentimes  two  or  more  of  these  methods  may  appear  in 
one  scale. 

Symonds  (3)  assumes  two  types  of  scales  in  his 
discussion  of  ''’Rating  vs  Ranking”,  i.e.,  the  rating 
scale  as  a type  and  the  ranking  scale,  or  ;.an-tOt  ian 
comparison  as  a ty  e. 

The  basic  purpose  of  the  rating  scale,  and  :he  under- 
lying theory  is  iuch  the  same  in  all  scales,  ut  in  the 
evolution  of  rating,  motivated  by  a desire  for  greater 
validity,  peculiar  types  have  e merged.  Differences 
in  methods  of  scoring,  classification  of  qualities  or 
habits  and  similar  bases  of  analysis 

(1)  Barr  5 Burton  - ’’The  Supervision  of  Instruction” 

pp . 468-480.  D.  Appleton  & Go . , 1926 

(2)  Preyd,  Max  - ”The  Graphic  Rating  Scale”  pp . 83-102 

Journal'  of  Educatonal  Psychology.  Vol.  3.4,  1923. 

(3)  Symonds,  P rcival  M.  - ”Hotes  on  Rating”  Journal 

A . -lied  Psychology.  Vol.  9,  pp . 186-195 
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will  hardly  determine  type,  but  differences  in 
principles  of  construction  are  the  basis  for  the 
classification  of  t -pes  of  scales. 

There  ap’ ear  to  be  four  types  of  scales,  i.e., 
the  simple  rating  scale,  the  graphic  rating  scale, 
the  man -to -man  comnar?  son  scale,  and  the  score  card* 

1.  The  simple  rating  so°le. 

The  simple  rating  scales  now  in  use  are 
adaptations  of  the  Boyce  (1)  scale  or  efficiency 
record.  Scales  of  this  kind  are  used  primarily  in 
the  supervision  and  administration  of  teachers  and 
in  self-ratin,  of  subjects.  A list  of  desired 
c alities  or  habit  is  selected.  Each  quality  is 
described  in  detail  by  a list  of  sub-heads,  each 
of  which  is  descriptive  of  some  factor  or  phase  of  the 
quality  to  be  m .as  red.  Thus  by  breaking  up  the  q ality 
into  a series  of  parts,  the  judgment  is  not  a 
lump  judgment  but  a series  of  concrete  judgments 
which  are  more  accurate  than  a general  estimate  of 
a quality  would  be*  Sometime  these  sub -headir  s ••  re  . 
stated  as  questions,  which  aids  in  -aking  the  judgment 
more  concrete.  Descriptive  concrete  uestions  also 
add  validity  to  the  test  by  accurately  defining,  in 
universal  terms,  the  phase  of  the  habit  which  is  to 

(1)  Boyce,  Arthur  Clifton-’’ Methods  of  Measuring  Teachers’ 
Eff iciency”--14th  Yearbook  Nat’l.  Society  for  the 
Study  of  Education  part  2,  PP  44-45. 
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be  observed. 

Three  or  five  columns  are  then  prepared  and 
the  rator  is  asked  to  place  a check  mark  in  the  column  which, 
in  his  judgment,  indicates  the  degree  of  the  presence 
or  absence  of  the  trait  being  observed.  The  columns 
may  be  headed  good,  medium,  poor,  or  A,  B,  G,  may  be 
used.  In  a five  point  scale  one  may  use  very  good, 
good,  medium,  poor,  very  poor,  or  A,  B,  C,  D,  E,  or 
1,  2,  3,  4,  5,  etc,  Numbers  are  often  applied  to 
each  of  the  five  columns  and  a numerical  score  is 
computed. 

The  following  sample  is  from  a scale  which  is 


used  in  the  University  of  Chicago  Plan  (1)  of  super- 
vising and  administering  practice  teaching,  and  is  a 
good  example  of  the  simple  rating  scale. 


F 

C 

B- 

B 

A- 

A 

1.  Skill  in  Teaching  technique 
Preparing  instruction 

materials 

Attending  to  individual  needs 
Developing  independence  of 
pupils 

Directing  pupil  study 

2.  Classroom  management  and 

school  routine. 

Attention  to  routine  matters 
management  of  pupils 

The  supervising  teacher  places  a check  mark 

in  the  column  which,  in  her • judgment , represents 

(1)  Breslich,  Gray,  Pieper  and  Reavis- "The  Super- 
vision and  Administration  of  Practice  Teaching1' 
Ed.  Adm.  I Sup,  Jan,  1925  pp  1-12 


. 


. 


> 


1 


- < l 


(0 
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the  degree  of  proficiency  the  student  has  reached* 
In  this  scale  P means  failure  and  A means  perfect. 
Brown  (1)  uses  the  simple  rating  scale  plan 
in  a self-rating  scale  for  students,  a sample  of 
which  follows: 


1. 

2. 

3. 

4. 


5. 


6. 

7. 

e. 

9. 

10. 


Punctuality 

Do  I keep  my  appointment? 

Do  I obey  my  parents  and 
teachers  promptly? 

Do  I perform  unpleasant 
tasks  promptly? 

Do  I return  borrowed  art- 
icles promptlv? 

Am  I e c D1"1  am  j r a 1 of  time 
both  at  work  and  play? 

Do  I arrive  at  school  on 
time? 

Do  I hand  In  written  work 
on  time? 

Do  I go  to  bed  and  get  up 
at  regular  hours? 

Do  I get  to  meals  on  time? 
Am  I prompt  and  gracious  in 
acknowledging  kindness? 


The  pupil  places  a check  mark  in  the  column 


wr ich  most  nearly  fits  him, 

Purst  (2)  suggests  a method  of  scoring  on  a 
five  point  scale.  He  selected  six  traits;  character, 
mind,  force,  social  qualities,  knowledge,  and  technique 


(1)  Brown,  Edwin  J-"A  Character  Conduct  Rating  Scale 
for  Students"-  Education,  Vol.  50:369-379. 

(2)  Purst,  Clyde -A  Simple  Literal  Personal  Rating 
Scale"  P 463  Educe t'rn el  a frii  p i s ration  and 
Supervision  Hov.,  1922. 
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each  with  twelve  to  eighteen  descriptive  sub-heads, 
and  used  the  vowels  a,e,i,o,u,  to  represent  degree 
from  best  to  worst.  By  combining  the  first  letter 
of  the  word  denoting  the  trait  with  the  vowel  re- 
presenting the  column  in  which  the  quality  was 
checked,  the  score  of  the  person  rated  is  read  in 
literal  fashion  for  the  perfect  individual,  CA,  NA, 

FA,  SA,  KA,  and  TA. 

There  is  no  particular  value  in  any  method  of 
scoring.  One  method  is  as  good  as  another  if  the 
judges  and  the  subject  understand  perfectly  the 
meaning  of  the  scores. 

Rugg  uses  this  type  of  scale  in  his  ’‘Rating 
Scale  for  Pupils  Dynamic  Qualities  (1),  form  A,  The 
headings;  Ability  to  learn  to  assimilate  new  ideas, 
qualities  of  Industry  and  Attitude  toward  school  work. 
Qualities  of  Leadership,  Teamwork  qualities.  Personal 
and  Social  qualities;  with  from  6 to  10  appropriate  sub- 
headings were  arranged  on  a five  point  self-rating  scale. 

A three  point  scale  of  five  characteristics  is 
in  use  in  the  public  school  system  of  Duluth  (2),  while 
a five  point  scale  of  five  characteristics  is  in  use  in 

(1)  School  Review  Vol.  28:337-349. 

(2)  Bracken,  John  L.-'‘The  Duluth  System  for  Rating 
Teachers'1  Elementary  School  Journal  Vol.  23: 

110-119. 
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the  schools  of  Madison,  Vise.  (1)  as  supervisory  in- 
struments. Both  are  excellent  examples  of  the  simple 
rating  scale. 

2.  The  Graphic  Rating  Scale. 

While  the  purpose  of  the  graphic  rating 
scale  like  that  of  the  simple  rating  scale,  is  to  judge, 
from  the  behavior  of  a subject,  the  presence  or  absence 
and  the  degree  of  presence  or  absence  of  desirable 
qualities,  the  construction  of  the  graphic  scale,  as  an  in- 
strument, is  very  different  from  that  of  the  simple 
scale.  A straight  line  is  drawn  which  represents  the 
range  of  the  quality  or  trait  which  is  being  observed. 

Using  ’honesty’  for  the  sake  of  illustration,  one  end  of 
the  line  is  to  represent  extreme  dishonesty  while  the 
other  end  represents  extreme  honesty.  If  the  scale  is 
to  be  a three  point  scale,  at  each  end  of  the  scale  under 
the  line  are  printed  descriptive  phrases  indicative  of 
the  two  extremes  of  the  quality.  Beneath  the  middle  of 
the  line  are  printed  descriptive  phrases  indicative  of 
the  neutral  or  mid-position  of  the  trait.  The  rator 
merely  makes  a check  mark  at  the  position  on  the  line 
which  represents  to  him  the  position  of  the  subject  with 
regard  to  the  trait  observed. 

( 1)  Giles,  J.T.-  'A  Recitation  Score  Card  and  Standards'1 
Elementary  School  Journal  Vol.  23:25-36. 
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The  following  is  a sample  of  the  graphic 
rating  method  taken  from  a graphic  rating  scale  of 
seventeen  qualities  by  Freyd  (1). 

1.  How  does  he  impress  people  by  his  physique 
and  bearing? 


Excites  Hoticeable 

admiration.  for  good 
Ver :/  physique 

impressive . 

bearing 


llak  e s ' ~ t rrtr ' " Arouses 

satisfac-  pressive  repulsion, 
tory  physical  Looked 

ression*  bearing.  do\m  on. 


The  rator  places  a check  on  the  line  at  the 
point  Which,  in  his  judgment,  indie  tes  the  position 
of  the  one  rated  with  regard  to  physical  bearing. 

Freyd  (2)  lists  thirteen  rules  for  constructing 
a graphic  rating  scale. 

1.  Decide  on  the  extremes  of  the  trait- -one 
extreme  of  a scale  may  have  several  opposites,. 

2.  The  line  should  be  of  such  length  that  a 
stencil  for  scoring  the  ratings  can  be  easily  cali- 
brated. 


3.  No  breaks  or  divisions  in  the  line. 


4.  The  line  should  not  be  more  than  five  inches 
in  length,  so  that  it  may  be  grasped  as  a unit. 


(1)  Freyd,  Max- :| The  Graphic  Rating  Scale"  pp.  83-102 
Journal  Educational  Psychology  Vol.  14;  1923. 

(2)  Freyd,  Max- *A  Graphic  Rating  Scale  for  Teachers  r 
Journal  Ed.  Research  Vol.  8 pp.  433-39. 


5.  Not  more  than  five  descriptive  phrases 
nor  less  than  three. 

6.  The  end  phrases  not  so  extremely  /orded 
as  to  be  seldom  used. 

7.  Phrase  descriptive  of  the  average  degree 
of  the  trait  should  be  in  the  middle  of  the  scale. 

8.  If  there  are  five  items,  the  intermediate 
ones  should  be  closer  in  meaning  to  the  center  one 
than  to  the  extremes. 

9.  Only  universally  understood  phrases  should 

• be  used. 

10.  Use  in  place  of  ''average,  fair,  excellent, 
etc.,  ' adjectives,  which,  in  themselves,  express  varying 
degrees  of  weight,  (for  "extremely  neat",  use 
"fastidious",  etc.) 

11.  Descriptive  phrases  short  and  to  the  point. 

12.  Phrases  set  in  small  type  with  plenty  of 
white  space  in  between. 

13.  Favorable  extremes  of  the  scale  should  be 
alternated  so  as  to  eliminate  the  motor  tendency  to 
check  on  one  side  of  the  page.  1 

Certain  virtues  of  the  graphic  method  immediately 
become  apparent.  It  is  simple,  concrete,  and  useable. 
The  recognition  of  unive  sal  descriptive  phrases  and 
the  fact  that  no  quantitive  measure  is  asked  for. 
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make  it  easily  h.ndled  and  quickly  scored. 

Freyd  (1)  as  used  this  principle  in  the  con- 
struction of  a scale  for  measuring  qualities  which 
make  for  success  in  teaching.  This  scale  attempts  to 
leasure  seventeen  qualities.  He  reports  : ’mediate 
interest  on  the  part  of  teachers. 

J II  . , . .. 

The  procedure  in  the  man- to -man  method  or  rank 
method  is  somewhat  different  than  either  of  the  above 
two  types.  The  simple  scale  and  the  ramhic  scale 
are  constructed  to  enable  a rator  to  judge  the  presence 
or  absence  and  the  degree  of  presence  or  absence  of 
qualities  in  an  individual.  The  man- to -man  method  is 
essentailly  the  comparison  of  individuals  onthe  basis 
of  the  habits  or  qualities  we  wish  to  measure.  The 
construction  of  a man- to -man  scale  would  probably  be 
done  in  this  fashion  ( i) . 

a.  A list  of  names  of  group  to  be  measured 

w ou Id  be  c om p i 1 e d . 

b.  The  desired  qualities,  completely  and 
carefully  defined  would  also  be  isted. 

(1)  Freyd,  I/lax  - 'A  Graphic  Rating  Scale  for  Teachers  ' . 
pp . 433-439.  Journal  of  Educational  Research.  Vol. 
8:1923. 

(2)  Rug;;,  H.G.  - nSelf -Improvement  of  Teachers  Through 
Self-Rating” . Elementary  School  Journal.  Vol.  20; 

pp.  670-684. 

”ls  the  Rating  of  Human  Character  Practical” 

Journal  Educational  Psychology,  Dec.,  1921;  485-501 
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c.  Subjects  in  the  list  would  then  be 
arranged  from  best  to  poorest  for  each  quality  or 


d.  Arrange  persons  as  accurately  as  possible 
in  five  groups . 

e.  Select  one  person  from  each  group  as  the 
best  in  each  group  to  occupy  the  position  orthe  scale. 

f.  assign  to  the  scale  people  the  following 
values,  ranging  from  . est  to  loorest;  68,30,22,  14, 
6.(1) 


.'hen  the  scale  is  used,  each  individual  in  the 
group  is  compared  with  the  scale  persons  on  the  five 
steps  of  the  scale  and  is  assigned  to  the  scale  man, 
or  scale  step  where  he  rightfully  e longs , y assign- 

ing a quantitive  numerical  value  to  each  person,  the 
total  score  for  the  whole  test  is  eas'ly  computed. 

For  instance,  John  Smith  is  the  most  honest  oy  in 
the  -roup,  .tnd  ,ve  lace  69  after  his  name.  ill  Jones 
is  above  average  but  is  not  as  hones  .s  John.  ie 
give  him  30.  Jim  Brown  is  extremely  dishonest  and  we 
give  him  6,  etc. 


(1) 


;g,  H*Q  . - ’’Self-Improvement  of  Teachers  Through 
Self-rating1’.  Elementary  school  Journal  .Vol  .20; 

' . 670-684,  ’’is,. the  Rating  of  Human  Charac- 

ter Practicable  . Journal  Ed,  Psy.  Dec., 

1921;  485-501. 
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We  find  that  Andy  Johnson  is  not  as  honest  as  John 
Smith,  hut  is  more  honest  than  Bill  Jones,  so  we  give  him 
34,  and  so  on,  until  every  person  has  been  compared  with 
the  scale  people. 

Scale  people  will  probably  differ  for  every  qual- 
ity. Bill  Jones  may  be  the  scale  man  for  the  next  lower  step 
than  the  top  in  honesty,  and  may  not  be  a scale  man  for 
diligence,  patience,  and  may  be  the  scale  man  at  the  lowest 
point  for  tact. 

Miss  Chassell  (1)  used  the  man-to-man  ranking 
method  with  kindergarten  children.  A sample  of  the  scale. 


-U  « IIUL/J.U  V J. 

a.  Ability  to  initiate 
projects  and  carry  them 
out. 

25 

. . V7...— ^ 
% 

b.  Ability  to  fail  and 
persevere. 

15 

c.  Ability  to  carry  out 
directions  of  others. 

5 

II.  Participation 

Names  of  Scale  People 

a.  Ability  to  contribute 
to  the  social  development 
of  the  room. 

5 

b.  Ability  to  take  an 
intelligent  interest  in 
the  social  activities. 

15 

c.  Ability  to  participate 
and  be  responsible  for  the 
social  organization. 

25 

(1)  Chassell,  Clara  P.  - '’The  Army  Rating  Scale  method  in 

the  Kindergarten1 11  — Jour.  Ed,  Psy.  Vol.  15;  pp.  43-52 
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Barr  and  Burton  (1)  point  out  that  some  critics  of 
this  method  ’’feel  that  it  would  be  difficult  to 
construct  a scale  using  the  names  o ° teachers  so  that 
very  many  people  could  be  familiar  enough  with  the  names 
used,  to  apply  the  complete  card.  : It  is  also  suggested 

that  criticism  from  teachers  condemns  this  method  on 
the  <_round  that  it  rates  the  doer  rather  than  the  deed. 

Rugg  (2)  says  of  this  method,  "The  task  of  oomparing 
one  person’s  q-  alities  with  another s is  fraught  with  so 
much  difficulty  as  to  be  impractical  in  rating;  the  rank 
and  file  of  persons  and  for  ?^ost  practical  activities  of 
life."  And  vet  be  uses  tMs  ^ef*  od  in  bis,  "Rating  Scale 
for  Pupil’s  Dynamic  O/ualities"  (3)  an  d i s self-rat  ing 
scale  for  teachers  (4). 

Haggerty  (5)  describes  the  Scott  comparison  scale 
as  the  first  significant  and  ambitious  effort  and 

(1)  Barr  and  Burton  - "The  Supervision  of  Instruction" 

Appleton  1926--P.  480. 

(2)  Rugg,  H.  0.  - "is  the  Rating  of  Human  Character 

Practicable"  Jour.  Ed.  Psych. 

Vol . 13.  Jan.  1922.  P.  30". 

(3)  School  Review  - Vcl.  28.  FF.  337-349. 

(<}  Rugg,  H.  0.  - "Self -improvement  of  Teachers  Through 

Self-rating".  El.  School  Journal 
Vol.  20  PP.  670-684. 

(5)  Haggerty,  M.  E.  - "Recent  Developments  in  Measuring 

Human  Capacities"  Jour,  Ed. 

Research  - April  1921  - PF.  241-253. 
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Scott  says  of  it,  " ./here  instructions  are  followed 
closely,  the  results  show  a high  degree  of  accuracy 
and  uniformity.  --Because  the  Rating  Scale  calls  attention 
separately  to  each  of  the  several  essential  qualifications 
for  an  officer, it  lessens  the  danger  that  judgments- 
may  he  based  on  minor  defects  / ith  a disregard  for 
corres  onding  virtues.  ' 

Thus  we  see  criticism  and  defense  of  the  ranking 
method.  I believe  we  are  safe  in  saying  that  in  some 
situations,  the  intelligent  handling  of  this  method  in 
the  evaluation  of  the  more  tangible  personal  habits 
will  yield  a x'airly  reliable  score. 

4 . i'-io  ..core  ^rd 

The  score  card  is  a form  of  rating  scale  in 
vl.  cm  the  various  items  are  weighed  by  preliminary  judg- 
lents  of  a group  of  persons  v ,ose  standing  is  recow.  iced 
and  ./hose  experience  in  the  particular  field  with  which 
the  score  card  deals  is  of  special  value.  Points  are 

d for  dif  ‘©rent  phases  of  the  scale  ...  d direc- 
tions  are  ^iven  as  to  the  basis  of  the.  rating,  one  of  the 
lost  interesting  forms  of  this  type  of  instrument  is 
the  1000  point  scale  public  ,ed  by  -he  Inter-Church 

(1)  Bcott,  ,.  D.  ‘‘The  Rating  Beale1’ --Pay 3hological 

Bulletin--  Vol . 15.' P.  204 


•x)  M 
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World  Movement  celled  " Standard  for  City  Chruch  Plants," 
a sample  of  which  follows: 


I.  Site , 

A.  Location 

1.  Accessibility 

2.  Environment 

B.  Nature  • nd  condition 
1.  Drainage  and  soil 
?.  Unkeep  of  site. 

C.  Size  and  form. 

The  descrietive  standard 
are  aesi  ned  to  aid  the  scorer 
f o Hows : 

. Standards  Involved  in  the  Site  of  s Church  School 

1 ant . 


13C 


O LO 

to  c 

55 

7 0 

vJ  — 

15 

15 

45 

or  the  directions  which 


in  his  estimation  are  as 


A.  Location 

1.  Acessibility 

a.  Near  enough  to  the  business  section  of 
the  city  to  profit  by  the  convergence  of 
roads  and  err  lines,  if  a " dovrntown,,  church. 

b.  In  the  direction  of  tve  city*s  growth 
rather  than  behind  it. 

c.  L0cated  centrally  with  respect  to  its  entire 
constituency . 

2.  Environment 

a.  Adjoining  attractive,  clean  nd  well-kept 
property  (trees,  lawns,  etc.) 

b.  Sanitary  and  healthful, — free  from  malodors. 

c.  Remote  from  fire  dangers, — not  adjoining  to 
large  ~rooden  or  non-fire-proof  buildings,  gas 
t^nks,  or  other  fire  spreading:  structures, 

d.  „uiet, — not  adjacent  to  any  factory,  planning 
mill,  or  plant  employing  machinery  or  shops 
such  as  tinsmiths,  auto  repair  shops,  pass- 
ing street  cars  or  railroad  trains.  Streets 
should  not  be  brick  or  cobblestone. 

e.  Not  near  overtowering  buildings,  but  placed 
in  proper  rchetectural  setting  on  a strate- 
gic .Location. 

B.  Nature  of  Site  and  its  condition 

1.  Drainage  and  nature  of  soil. 

a.  Natural  slope  preferred,  sloping  away  from 
building  at  a minimum  slope  of  1 inch  in 
three  feet. 


< 


I 


t 
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b.  Entire  site  should  be  thoroughly  tiled  with 
special  provision  for  the  basement . Pro- 
tected from  surface  water  from  higher  con- 
tiguous ground.  Nature  of  soil  should 
determine  the  depth  of  the  tile. 

c.  Sandy  loam  and  fertile  enough  for  good  lawns 
and  landscape  gardening, 

d.  Playground,  quick  drying,  (rapidly  drained) 
with  turf  or  artificial  surface  of  crushed 
stone  or  gravel.  Natural  soil  preferred  to 
artificial. 

2.  Unkeep  of  Site. 

a.  Entire  site  should  show  evidence  of  proper 
maintainance.  Lawns  should  be  well  kept; 
shrubbery  well  trimmed;  walks  clean  and  in- 
good  repair;  fences  or  walls  in  good  state 
of  preservation.  Grounds  should  be  free 
from  unsightly  ash  piles,  waste  paper, 
rubb i sh  of  any  kin d and  weeds. 

C.  Size  and  form  of  site 

a.  Should  be  large  enough  and  of  a shape  to 
allow  for  the  proper  placing  of  building 
or  buildings  and  for  future  additions. 

b.  Should  be  large  enough  to  provide. 

(1)  In  front  for  ample  lawns  and  shrubbery 
for  outdoor  fetes,  pageants  and  other 
festivals . 

(2)  In  rear  for  playgrounds,  tennis  courts, 
ball  ground,  and  other  athletic  facilities 
to  be  provided. 

c.  A plot  from  5 to  10  acres  depending  upon 
the  size  of  the  community  to  be  served  is 
necessary  for  these  activities, 

d.  Where  city  congestion  is  such  to  prevent 
acquisition  of  standard  site,  roof  garden 
should  be  planned  for  festivals,  song 
services,  play  and  other  activities.  Its 
construction  should  care  for  the  following 
elements: 

(a)  Adequate  roof  covering,  rail 
protection,  shield  against  wind, 
rain  and  snow. 

(b)  Storage  facilities  and  the  extension 
of  all  service  systems  to  the  roof 
garden. 

( c)  Special  equipment  consisting  of 
tables,  chairs,  portable  stage  and 
piano. 

e.  Y/here  playground  and  athletic  field 
are  separated  from  the  church  site,  they 
should  not  be  so  distant  that  the  school  and 
gymnasium  equipment  cannot  be  used. 


The  scorer  marks  in  the  blan  k t’pac  newt  to  the 
amount  assigned  tr  the  factor  under  oh:  ervation , an 
amount  which,  in  his  .judgment,  corresponds  to  the  degree 
in  which  the  building  under  observation  approximates 
the  standard . Bach  element  on  the  care  is  taken  singly 
and  is  scored  in  the  light  of  the  descriptions  in  the 
standard.  The  final  score  is  then  omput  d for  all  the 
factors  observed  which  stands  for  the  degree  in  dnich 
the  church  under  observation  approaches  the  standai  . 

Thus  we  see  that  the  sc  or-"  card,  as  an  instrument 
of  measurement,  has  many  t'  ingr-  in  common  with  the 
typos  of  rating  scales  which  we  have,  been  considering, 
but  there  are  also  difference s between  the  rating  scale, 
os  ■ - r:  hav  discussed  it,  • nd  the  score  card. 

In  the  first  lace,  the  score  card  provides  a 
convenient  method  of  recording  judgments  vd  ich  is  perhaps 
as  concrete  as  any  rating  scheme  can  be#  Tor  instanc  , 
if  the  value  30  is  given  to  accessibili t y and  the  actual 
score  of  a chore’  r fifteen,  -he  av  re  • person  looking 
at  t"  a scale  would  have  a more  concrete  idea  of  how  nearly 
the  church  compared  with  the  ideal,  than  he  v uld  if 
the  scale  read  very  good,  or  poor,  or  a check  mark  showed 
on  a graphic  scale,  due  to  the  universal  recognition  of 
numerical  values  and  the  relationship  of  fifteen  to  thirty 
This,  of  course,  does  not  mean  that  the  judgment  is  as 
accurate  as  the  number  fifteen  indicates,  due  to  the  sub- 
jectivity entering  into  the  scorer's  judgment  as  to  how 
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nearly  the  church  under  observation  approximates  the 
standard,  but  it  does  men"  thrt  it  is  recorded  in  univer- 
sally understood  terms. 

In  the  second  place  the  descriptions  i the  standard 

which  are  used  as  a guide  to  rating,  are  very  similar  to 
the  descriptions  of  divisions  on  a graphic  rating  scale. 
However,  much  ore  detailed,  description  and  defmit  or 
is  possible  in  the  use  of  a score  card  and  standard  than 
it  is  in  the  use  of  another  type  of  rating  scale. 

In  the  third  place,  different  values  are  ascribed 
to  different  qualities  on  the  scale,  indicating  that  some 
elements  to  be  scored  are  of  more  importance  than  some 
others.  This  can  be  done  with,  thoroughly  objective  data 
such  as  the  Standard  for  City  Church  Plants  deals  with,  but 
we  car  hardly  assume  that  some  of  the  more  intangible  elements 
of  character  are  of  more  5mportan.ce  than  others,  much  less 
the  depree  to  which  the'tr  cm-rort  °nt . One  could  hardly 

sa  that  diligence  in  a certain  situation  was  of  more  value 
than  courage  in  the  same  situation,  much  less  how  much  more 
valuable.  This  leads  to  an  interesting  question  as  to  where 
the  dividing  line  is  between  tangible  and  intangible  qualities. 

Yepsen  (1)  presents  a score  card  for  personal  behavior 
in  an  attempt  to  state  objectively  the  social  ad.aptibility 
of  the  individual.  At  the  time  of  this  writing,  however,  no 
satisfactory  method  of  scoring  had  been  reported. 


(1)  Journal  Applied  Psychology  Feb.  1928,  FP  140-147 
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A sample  of  the  card  follows: 

Attitude  of  Others  Toward  Pin 

Choose  him  p?  leader. 

Accept  him  ss  leader. 

Play  with  him  occasionally,  not  often. 

Seek  his  companionship. 

Ignore  and  shun  him. 

Accepted  readily  as  one  of  the  group. 

Butt  of  crowd  pick  on  him. 

Here  again  the  data  is  more  or  less  objective  inasmuch 
as  actual  observable  reactions  of  a specific  nature  are  the 
basis  of  the  study.  At  least  it  is  possible  to  ^et  a rather 
l eneral  agreement  concerning  them. 

In  the  fourth  place,  agreement  on  the  part  of  experts  in 
the  development  objective  standards  is  possible  for  the  more 
objective  data  while  it  is  impossible  with  the  more  subjective 
data  in  the  field  on  morels  or  character.  H°rtshorne  and  May 
(1)  discovered  a wide  difference  in  codes  between  people  of  one 
type  or  social  strata  and  another. 

Thus  the  same  principle  of  rating  is  used  with  the  score 
card  as  with  other  types  of  rating  scales,  except  a carefully 
prepared  objective  standard  is  prepared  against  which  to  judge 
and  against  which  to  score. 

C - Criticism  of  Rating  Scales . Cert ain  inherent  weaknesses 

in  the  matter  of  rating  invite  a great  deal  of  criticism  which 

classifies  itself  under  three  general  headings:  first,  the  question 
of  the 

(1)  "Testing  the  Knowledge  of  Right  and  Wrong"  Mono  raph 

1928  PP  31-32 
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existence  of  traits  to  be  measured  which  reflects  the 
influence  of  varied  psychological  theories.  Secondly, 
criticism  from  the  standpoint  of  facility  in  the  adminis- 
tering and  scoring  of  a given  scale.  Third  1 , trie 
problem  of  the  validity  of  the  scale  and  the  reliability 
of  the  scores.  The  first  is  a matter  of  psychological 
definitions,  the  second  is  non-statistical  criticism, 
and  the  third  is  statistical  criticism. 

1.  The  existence  of  traits. 

nre  there  such  things  as  character  traits?  Are  e 
trying  to  measure  something  which  actually  exists?  These 
are  questions  commonly  asked  by  behaviorist's . Three 
studi  xi  of  this  question  (l)  have  been  made  and  certain 
conclusions  become  apparent  as  the  result  of  the  findings 
of  these  studies. 

The  psycholigical  view  point  of  the  individual  facing 
the  problem  'ill  determine  the  answers  to  the  above  two 
questions.  If  we  hold,  with  the  facultative  psychologist, 
that  character  is  native,  then  we  must  assume  the  existence 
of  general  character  traits.  If,  however,  e hold  * x.  th 
the  behaviorist , that  character  is  acquir  throve  k.  the  in- 
fluence of  experiences  in  life  situations,  we  question  the 
assumption  on  the  grounds  that  char act  -r  is  not  dis tinguis/ - 
able  apart  from  the  acquiring  process,  or  apart  from 

(1)  Symonds,  Percival  .-'’The  Pros  mt  Ststus  of  Character 
Measurement**1,  Journal  Education  P ] . 3 - 

t r , P * A.  & Lehman,  . 1 . - ' 5-eall  ] r 

s'-. t"  , Psxcholoxical  ' ■ : view-lTov.  , 19 P.7  pp.  401-413. 

S • ine-**A  Critical  Study  in  the  Objective  Measur 

nt  of  Character*,  Jour.  Ed.  R ] v.,  1 r pp.  290-296 
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situationo.  This  does  not  mean,  however,  that  the  qualiti< 
by , i , c,,  are  1 - 

siti  ins,  hut  it  does  mean  that  they  are  non-existant 

m-om  life  situations.  Hence  a very  real  question  re- 
garding the  validity  of  a r neral  character  te-  t. 

Witty  and  Lehman  (l),  classify  tests  of  moral  charac- 
ter into  three  types;  (a)  Those  involving  reactions  to 
laboratory  or  class-room  situations;  (h)  These  involving 
reactions  to  hypothetical  questions  regarding  moral 
situations;  (c ) Those  involving  reaction  to  lif  itiv  - 
tions . 

Their  conclusions  are;  that  the  fact  that  the  r latien 
ship  h tween  knowing  and  doing  is  not  measured  in  the 
first  type  of  test,  character  is  not  measured;  that  real 
temptations  seldom  exist  in  laboratory  situations,  hence, 
character  is  not  measured,  due  to  the  multiplicity. of  mays 
in  which  a tr?  if  manifests  itself. 

The  la;  t t o paragraphs  in  the  article,  evir1-  ntly 
intended  as  a summary  of  their  position,  read  as  follows: 
(p.4-13)  "If  morality  then  is  acquired,  and  acquired  in 
terns  of  specific  habit  formation,  our  task  in  the  schools 
is  that  of  teaching  children  to  choose  intellig  ntly, 
those  habit'  which  ;ill  function  for  the  good  of  others. 

(l)  "The  So-called  General  Character  Test" 

rcl  alogi  .1  : view-Hov.,  1927.  pp.  401-413 
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This  means  that  instead  of  attempting-  to  develop  a few 
specific  traits,  with  the  expectation  that  these  traits 
will  transfer  to  situations  outside  the  classroom,  we 
should  see1  out  diligently  those  specific  habits  which  we 
call  good  in  life  and  make  provision  for  their  acquisition. 

If  one  accepts  the  point  of  view  the  t character 
is  acquired  in  terns  of  habits  of  action  (and  who  ha: 
on  - evidence  to  the  contrary?)  the  attempts  at  character 
measurement  appear  spurious  and  unnecessary. 

This  conclusion  is,  at  first  glance,  erroneous. 

Suppose  we  grant'  the  above  position  that  character 
is  a c c u i r :■  d , a n d does  not  e x i o t ap a rt  f r on  1 i f e 1 £ 
situation.  Suppose  we  "seek  out  habits  which  e call 
good  in  life  and  raa'-e  provision  for  their  acquisition", 
how  can  a ever  be  sure  that  our  *nrovisionr  for  acquisition", 
or  training  orocess,  ir  functioning.  7e  must  have  some 
method  of  evaluating  the  process  if  -e  wish  to  know  the 
rate  of  efficiency  with  which  me  are  doing  our  task,  how 
1 j shall  this  come  than  from  the  observation  of  the 
change  in  habit;  in  the  subject?  'hat  are  e going  to 
measure  but  the  manifestation  of  the  presence  or  absence 
of  those  had  its? 


♦ 
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A more  accurate  conclusion  to  this  article  would  be, 
that  general  character  tests  are  undesirable  and  that  the 
only  valid  type  of  character  test  is  one  which  involves 
life  situations.  This  is  the  conclusion  Brown  and 
Shelmadine  (1)  reached  after  classifying  the  available 
tests  in  four  types;  (a)  Beales  in  which  a person  is 
either  rated  or  rates  himself  for  specific  traits;  (b) 
Tests  of  temperamental  traits  which  measure  temperamental 
reaction  n a controlled  situation;  (c)  Pencil  and  paper 
tests;  (d)  Series  of  controlled  situations  such  .s  the 
Voelker  tests. 

Can  we  not  say  then  that  qualities  of  character  do- 
exist  in  life  situations;  and  can  we  not  formulate  two 
principles  for  the  construction  of  a character  scale? 

A- ‘’E  very  item  in  the  scale  should  be  defined  in 
items  of  behavior.  We  can  judge  one's  possession  of 
a given  trait  (or  quality)  only  on  the  basis  of  its 
outward  manifestation.  Objective  censiderat ions  sho’  Id 
enter  into  all  our  ratings.  From  these  e make  in- 
ferences concerning  subjective  qualities. 

B. -Personal  qualities  or  habits  are  manifest  only 
in  appropriate  situations.  If  there  is  no  opportunity 
for  exercise  of  the  trait  in  question,  the  rating  on 

(1)  "A  Critical  Study  in  the  Objective  heasurement  of 

iaracterM • Journal  of  Educational  Research,  1928 

pp.  290-296 


that  trait  is  worthless  (1). 

2.  Non-statist ical  Criticism. 

Non-stat istical  criticism  includes  tie  selection 
of  trait:  , ease  of  administration  nd  .corin' , 
simplicity  of  toe  re tiny  scale,  time  require'  and  the 
agreeableness  of  tl  • task.  Often  times  the  list  of 
qualities  to  be.  observedis  so  Ion-  tsat  an  overlaopin 
of  qualities  i immedi?  tely  eoperent,  : nd  the  scale 
becomes  complicated  and  formidable.  Amain  !'•  -ethod  of 
scoring  by  f:  e use  of  a stencil,  a master  sc  le  or  a 
statistical  formula  limits  the  use  of  the  scale  to  a f e™ 
experts  in  the  field  of  measurement.  Also  the  selection  of 
the  qualities  is  often  not  miss,  in  that  they  are  not  of 
universally  recognized  importance,  end  the  descriptive  terms 
are  not  universally  recognizable. 

These  criticisms  point  to  the  need  of  orincioles 
in  the  selection  of  traits  and  the  determinat ion  of 

t 

methods  of  scoring. 

(3)  1.  The  list  must  be  relatively  short  so  that 

the  student  (or  rat or)  shall  not  be  lost  in  the  maze  of 
different  cue lit  is  . 

(1)  Hughes,  W.  Hard in- "General  Principles  ar.c.  Re  :-.u It of 

Rating  Trait  Character 1st ic£"-Journa 1 of  Educational 
method-Vol.  4:  pp  1934-1325 

(2)  Brandenburg,  G.  C.  & Rammers , H*H. -"Rating  dealer  for 

Instructions” -Educational  Adn inistr? tion  & Super vis ion- 
Vol . 13:  o 99-40 S 
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(1)  2.  Traits  must  to  such  as  are  generally  agreed 
upon  by  competent  critics  as  most  important. 

(2)  3.  It  is  essential  that  every  term  in  the  rating 
scale  be  defined  as  unambiguously  as  possible.  If  the 
contents  of  a given  term  are  too  varied,  comparable 
ratings  are  impossible. 

4.  The  method  of  scoring  must  be  simple  and  easily 
grasped . 

3.  Statistical  Criticism. 

(Questions,  which  arise  in  the  use  of  the  rating 
scale,  include  the  following:  _‘o  what  extent  does  the 
score  of  a scale  measure  the  existence  of  absence  of 
the  true  qualities  of  an  individual?  .hat  causes  varia- 
bility in  independent  ratings?  how  ca  .tie  reliability 
of  the  ratings  of  an  individual  be  increased?  ..hat  are 
the  problems  which  arise  in  rating? 

In  some  types  of  rating  scales  there  is  an  error 
in  the  score  due  to  the  Inability  of  the  rator  to  clarify 
and  formulate  his  reactions  to  a given  situation.  If 
the  scale  is  so  cons  tructed  as  to  enable  the  rator  to 
select  a phrase  which  most  nearly  describes  his  reactions, 
rather  than  to  make  a spontaneous  response,  this  error 

(1)  brandenburg,  G.J.  U Remi.ier.s,  K.k. -''mating  Scales  for 

Instructions11 -educational  Administration  n Supervision 
Vol.  13:  3 9-406. 

(2)  Hughes,  u .li.-'1  General  Principles  and  Results  of  Rating 

Trait  Characteristics'1-  our.  Ed.  met  od4:  pp  1924-1925 
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1s  diminished. 

Another  error  in  judgment  is  caused  by  an  inade- 
quate understanding  of  what  is  being  measured.  Descrip- 
tive phrases  must  be  fool-proof,  phrased  in  universally 
accepted  terms  and  specific.  This  is  also  largely  taken 
care  of  in  the  construction  of  the  scale. 

There  are,  however,  at  least  four  personal  factors 
in  judging  which  can  not  be  eliminated  in  the  construc- 
tion of  the  scale.  They  are  as  follows;  (a)  different 
standards  of  excellence  held  by  different  rators;  (b ) 
differring  abilities  to  distinguish  degrees  of  existence 
or  non-existence  of  the  trait  under  observation;  (c)  the 
influence  of  friendship  or  animosity,  and  already  formed 
prejudices  'or  or  against  the  subject  on  the  part  of 
the  rator,  This  is  commonly  known  as  the  influence  of 
’’halo'1 ; (d)  the  lack  of  knowledge  of  the  subject  on  the 
part  of  the  rator  which  is  very  apt  to  warp  the  score. 

a.  Unfortunately  for  rating,  we  are  not  all 
turned  out  of  one  mould.  The  varying  background  and 
experience  of  individuals  produce  different  standards 
of  judgment,  different  mental  and  cultural  habits, 

'ferent  psychological  background.  Hanna  (1)  found  a 
wide  variability  between  the  judgments  of  teachers,  teaching 


(1)  Hanna,  Joseph  V.-'1  Variable  Factors  Encountered  the 
Rating  of  Student sM -School  Science  cc  Mathematics 

Vol . 25:  481-488 


different  types  of  subjects,  in  the  rating  of  Junior 
college  Students  on  application,  ability  to  organize, 
accuracy,  punctuality,  aggressiveness  and  social 
qualities.  He  found  less  variability  between  the 
judgments  of  teachers  of  the  same  subject  background. 

The  wide  range  of  religious  belief,  the  large  percentage 
of  people  who  scoff  at  religion  and  the  environmental 
differences  make  this  immediately  apparent  in  the  judg- 
ment of  character  qualities  and  moral  habits.  '.That  is 


immoral  to  one  person  may  be  non-moral  to  another. 


b.  Different  abilities  to  distinguish  in 
degree  points  immediately  to  the  need  of  competent 


judges.  A competent  judge  is  one  who: 

(1)  Is  familiar  with  the  scale  or 
instrument , 

(2)  Understands  and  is  in  sympathy 
with  the  idea  of  measurement  by 
rating, 

(3)  Is  familiar  with  and  agrees  upon 
the  qualities  under  observation. 


(4)  Is  vitally  interested  in  the 
qualities  measured, 

(5)  Has  had  sufficient  practice  in 
rating  to  have  become  proficient. 


(6) 


Knows  the  subject  rated  well 
enough  to  interpret  his  natural 
reactions  to  situations,  but  not  so 


well  that  he  will  be  influenced 


"halo’1. 


by 


c 


The  influence  of  "halo1'  . A rator  often  rates  a 


subject  high  if  the  subject  is  well  known  and  well 
liked  by  the  rator,  op  vice  versa.  Tills  does 
that  the  ratop  is  dishonest,  but  it  does  mean  that  the 
feeling  of  the  pat op  fop  the  subject  influences  the 
judgment.  This  is  ot  restricted  to  the  matter  of 
friendship*  Often  a teacher  will  allow  the  scholar- 
ship or  academic  standing  of  a student  to  influence 
the  judgment  on  a general  quality. 

For  instance,  Knight  and  Frarizen  (1)  report  a 
correlation  of  0.95  etween  moral  character  and 
quality  of  voice,  in  a judgme]  t of  several  prospec- 
tive teachers.  Obviously  moral  character  has  othing 
to  do  with  quality  of  voice  nor  has  quality  of  voice 
anything  to  do  with  character.  This  means  that  because 
the  ratings  of  ;oral  character  and  the  ratings  of 
quality  of  voice  were  so  nearly  ’’alike'*  or  ’identical 
quality  of  voice,  if  pleasing,  influenced  the  judges  to 
rate  the  subject  high  in  moral  character,  and  if  dis- 
pleasing, to  rate  the  subject  low  in  moral  character. 
Thus  quality  of  voice  influenced  the  judgment  and 
operated  as  “halo. ' 

Symonds  (2)  lists  five  reasons  for  the  influence  of 

(1)  Knight  and  Franze  - 'Pitfalls  in  Hating  Schemes'1  - 

Journal  Ed.  Psych.  - Vol.  13:204. 

(2)  3;  ds,  Percival  M. -"Notes  on  Rating"  Journal  of 

applied  Psychology-Vol . 9:188-198. 


-79- 


"halo*'  in  ratings. 

a -The  trait  or  habit  is  net  easily  observed. 

b -Trait  or  iiabit  is  not  comonly  observed  and 
thought  about . 

c-The  trait  or  habit  is  not  easily  defined. 

d-The  trait  or  hat  it  i .volves  reactions  with 
other  people,  rather  than  mere  personal 
behavior . 

e-The  trait  or  habit  is  one  with  high  moral 
importance  in  its  usual  connotation. 

„e  are  now  faced  with  the  problem;  how  can  the 
influence  of  '‘halo  1 be  minimized? 

One  way  to  minimize  “halo11  in  judgments  is  by 
care  in  the  construction  of  the  scale.  Hughes  (1) 
lists  three  principles  in  the  construction  of  the 
scale  which,  if  followed,  ./ill  minimize  the  effect  of 
;‘iialo  ' . 

1.  Unity  o Bef inition--It  is  essential  that 
every  term  in  the  rating  scale  be  defined  as  inambiguousiy 
as  possible.  Contents  of  a given  term  must  not  alloy/ 
wide  range  of  interpretation  of ' its  meaning. 

2.  Behavioristic  Definition- -Every  item  in 
the  scale  should  be  defined  in  terms  of  ehavior. 

Habits  and  qualities  can  only  be  judged  on  the  basis  of 
their  outward  manifestation.  Inferences  concerning  sub- 
jective qualities  can  only  be  made  on  the  basis  of  tangible 

(1)  Hughes,  w.  Hardin-*  General  Principles  and  Results  of 

Rating-Trait  Oliaract eristics'1  Journal  of  Educational 
method-  4:1924-25, 
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objective  reactions  to  given  situatio  is. 

5.  Relation  to  situation- -Personal  qualities 
or  habits  are  manifest  onl  ii  appropriate  situatio 
If  there  is  no  opportunity  for  exercise  of  the  habit 
in  question,  the  rating  on  the  habit  is  worthless. 

For  example,  suppose  we  wish  to  measure  the  neat- 
ness of  a teacher.  >e  may  build  a scale  of  this  sort. 

Neatness  Ex.  V.G.  G . P.  V.P. 

1.  Personal  appearance 

2.  Habits  of  work 

The  rator  exp  -esses  his  judgment  by  placing  a 
check  mark  in  one  of  the  five  columns  • One  of  the 
faccors  which  will  probably  operate  to  govern  his 
choice  of  one  of  the  five  columns  will  be  his  like 
or  dislike  for  the  teacher. 

However,  if  we  construct  a scale  as  follows: 

Ex.  V.G.  G.  P.  V.P. 

1.  hoes  she  place  pencils, 
papers  and  other  teaching 
tools  carefully  away  in 
a drawer  at  the  close  of 
the  day? 

.,e  are  recording  our  judgment  of  specific  activity 
and  there  is  less  liability  of  the  sa. ;e  degree  of 
“halo  1 which  was  operative  in  the  first  type  of 

scale . 

We  may  go  still  further  and  help  make  the  judg- 
ment more  concrete: 
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Meticulous. 

Places 

Places 

Throws 

Leaves 

Bach  paper 

tools 

tools 

tools 

papers 

and  each 

away 

hurriedly 

hurriedly 

and 

pencil  in 

neatly 

in 

into 

pencils 

proper 

in 

drawer . 

drawer 

scattered 

place  in 
drawer . 

drawers. 

Drawer 
shows 
results 
of  haste. 

when  she 
thinks 
of  it  • 

over  her 
desk. 

By  asking  the  rator  which  type  of  activity  most 
nearly  fits  the  teacher,  we  are  minimizing  the  in- 
fluence of  “halo'1  still  :o  >e . 

Another  v/ay  of  minimizing  the  influence  of  '’halo'1 
in  single  rati,  gs  is  to  provide  a com  ion  mental  back- 
ground for  a group  of  rators.  This  may  be  done  in 
conference  before  the  ratings  are  made,  or  better  yet, 
if  the  persons  using  the  scale  could  share  in  the  co.  - 
struction  of  it.  In  some  such  v/ay  as  the  Army  Rating 
Beales  were  built,  a common  mental  background  could 
easily  be  established.  At  least,  the  rator  could  be 
shown  what  to  look  for  in  the  v/ay  of  qualities  or 
habits . 

This  leads  us  to  the  third  suggestion, --the  com- 
petency of  rators.  The  qualifications  of  a competent 
rator  have  been  indicated  on  the  preceding  pages.  Rugg  (1) 
found  the  average  deviation  for  competent  rators  less 
than  any  other  group. 

(1)  nIs  the  Rating  of  Human  Character  Practicable” 

Journal  Ed . Psychology-Jov-Dec  1921  - Jan,  Feb.  1922 
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Another  suggestion  for  minimizing  the  influence 
of  ’'halo'1  is  given  by  Hughes  (2)  as:  Freedom  from 

Emergency#  Other  things  being  equal,  ratings  are  more 
reliable  when  not  affected  by  emergency . if  there 
is  no  in  ;ediate  need  r information,  the  rating 

will  e more  free  from  bias.  If  a rati:,  is  for  the 
purpose  of  recommending  a man  for  a position  and  the  rator 
knows  he  need  the  position,  his  judgment  is  apt  to  be 
influenced  by  his  knowledge  of  the  need. 

A fifth  suggestion,  also  listed  by  Hughes,  is 
in  the  handling  of  the  scale. 

In  general,  ratings  are  .ore  reliable  when  made 
on  a single  quality  at  a time  for  an  entire  group  than 
when  made  on  all  qualities  for  an  individual.  This 
suggests  that  the  influence  of  a judgment  on  one  quality 
is  apt  to  be  felt  in  the  judgments  of  other  qualities. 
Therefore,  it  is  necessary  as  far  as  possible  to  dismiss 
all  other  qualities  and  habits  from  mind  and  concen- 
trate on  the  sin  le  quality  to  be  observed. 

d.  The  lack  of  knowledge  of  the  subject  on 
the  jjart  of  the  rator  is  another  evide  ce  of  the  necessity 
of  competent  rators.  This  might  be  called  by  some  an 
advantage  due  to  the  limiting  of  the  influence  of  "halo", 

(2)  "General  Principles  and  Hesults  of  Rating* -Journal 
Ed.  Meth.-  Vol.  4:1924. 
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but  unless  a rator  knows  a subject  well  enough,  there 
will  l e several  manifestations  of  o'  servable  qualities 
•which,  the  rator  will  overlook. 

However,  the  opposite  of  this  is  true.  Knowing 
the  subject  too  well  has  a bad  effect  on  rating,  parti- 
cularly in  the  operation  of  ‘halo'  on  the  judgment. 

Knight (1)  points  out  that,  ‘the  factor  of  acquaintance 
operates  to  make  ratings  more  lenient,  i.e.,  increases 
the  over  rating,  and  to  make  ratings  less  critical  .nd 
less  analytical,  i.e.,  increases  the  influence  of  the 
‘■'halo  ' of  the  general  estimate"  . 

At  first  glance,  the  problems  involved  by  per;  mal 
factors  in  judging,  seei.  to  present  un surmountable 
obstacles,  many  times,  for  this  reason,  the  rating 
scale  is  considered  of  no  value  as  an  instrument.  How 
can  we  obtain  reliable  ratings  on  a given  su'  ject? 

Preyd  (2)  lists  sever  stati: tical  criteria  for 
increasing  the  reliability  of  vhe  results  of  rating. 

This  is  perhaps  the  lost  complete  list  although  Rugg  (5), 
in  his  experiences  with  the  army  Rating  Scale  mentions  most 

(1)  Knight,  F.  B. -“affect  of  the  Acquaints  co  Factor  Upon 

Personal  Judgments “-Journal  of  Ed.  Psych. 

Vol . 14  - p.  1.42 

(2)  preyd,  Max-,,The  Graphic  Rating  Scale”- Journal  of 

Rducatio  al  Psycholo  ; - Vol.  14:  1923 

pp.  83-102 

(3)  Ru  . .0 ” Is  t ie  Rati:  of  fuman  Character 

Practicable?"- Journal  Ed.  Ps  choloer  - ov.  1921 

pp . 423-438;  Dec.  1921-pp  485-501;  Jan  1922 

pp . 30-42;  Feb.  1922-  p 81-93 
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of  the  above,  either  directly  or  indirectly,  while 
.fat son  (1)  explains  the  principle  of  correlation  as 

a means  of  increasing  r teasures. 

A.  A method  o * . .creasing  '-he  reliability 

of  measures  used  by  Rugg  (2)  and  Folso. . (5)  is  by 
correlating  these  with  l.Q,.  scores  or  other  o jective 
measures.  Rugg  attempted  to  correlate  the  scale  scores 
of  individuals  and  I«Q.  scores  of  the  same  individuals. 

Folsom  attempted  to  correlate  classmates  judgments  of 
166  men  on  eleven  character  traits  in  a small  college, 
professor’s  judgments  on  four  traits,  performance  re- 
cord in  social  popularity  and  athletics,  results  of 
physical  examination  and  scores  of  responses  to  a two- 
series  of  advertisements  test. 

nugg  found  in  his  experiment  with  the  Army  Scale  no 
correlation  between  the  scale  score  of  an  individual  and 
the  I.Q,.  score.  Freyd  (4)  came  to  the  cor  elusion,  'that 
it  is  next  to  impossible  to  make  statistical  comparisons 
between  kinds  of  rating  scales.  It  seems  likely 

(1)  /at son,  B.G.-^Expermentation  and  Measurement  in  Religious 

Education.  1 -association  Press-1927  - pp  44-45. 

(2)  Ru  ;g,  Ei.O.-wIs  the  Rating  of  Juman  Character  Practicable ?a 

Jour.  Ed.  Psych. -Nov.  1921-pp .425-38;  Dec  1921:485-501 
Jan.  1922-pp . 30-42;  Feb.  1922:81-93 

(3)  Folsom,  Jos.  K.-1,a  Statistical  Stud;:  of  Character11 

Pedagogical  Seminary  & Jour.  Genetic  I £ c .-Vol.  24:89b-  _ 2 

(4)  Freyd,  Max-^A  graphic  Rating  Scale  for  Teachers*  Jour. 

Ed.  Research. -Vol . 8-p . 453. 
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that  ratings  could  be  evaluated  by  correlating  then 
with  some  variable,  such,  as  an  objective  measure  of 
the  particular  trait  upon  which  the  ratings  are  made. 

But  ratings  are  ultimate s in  Psychology  and  cannot  be 
evaluated  with  reference  to  a known  criterion.  If  such 
a criterion  were  available,  there  would  be  no  need  to 
make  ratings.1' 

B.  Another  method  of  increasing  reliability  is  to 
compare  the  ratings  on  the  sane  subjects  by  the  same 
judges  for  different  months.  Phis  is  rarely  a safe- 
guard against  the  influence  of  “halo'1  • The  judgment 
of  the  rator  is  as  apt  to  be  influenced  by  ‘’halo1'  the 
second  or  third  month  as  it  is  the  first. 

C-.  Another  method  is  the  comparison  of  the  ratings 
on  the  same  men  by  different  judges.  This  is  perhaps 
the  best  Let  tod  .oned*  The  average  of  three 

independent  ratings  is  apt  to  be  a more  accurate 
measure  of  the  existence  of  a trait  than  any  single 
rating.  Rugg  (1)  says:  '’Assuming  qualified  rators,  the 

reliability  of  a judgment  increased  directly  with  the 
square  of  the  number  of  judgments.  Pf  the  probable 
error  (P.  E.)  on  a single  judment  is  0.6745;  of  two 
judgments  It  Is  0.476;  of  three  judgments  it  is  0.386; 
and  of  four  judgments  it  is  0.545. 

(1)  nu  g,  h.0.-uls  the  hating  of  Human  Oharacter 

Practicable !l  Journal  Ed.  Psy.  - Feb.  1922-P  1-83 


D.  Another  index  of  reliability  is  the  normality 
of  distribution.  This  means  that  the  scores  for  a 
large  number  of  individuals  selected  at  rando  . ought 
to  folio./  the  . ormal  Probability  Curve,  (1)  which  on  a 
five  point  scale  is  indicated  roughly  by  these  general 
percentages:  7'/o  - 24 % - 38 % - 24/o  - 7 /o.  Stated  in 
another  way,  we  might  say  that  in  a la  umber  of 
cases  the  total  number  of  individuals  would  fall  into 
their  proper  fifth  of  the  scale  as  follows;  7%  lowest 
aih  7/o  highest,  38 % in  the  middle ; 24. i between  the  high- 
est and  middle  and  24>o  between  the  lowest  and  middle. 

If  this  is  iot  the  case,  it  is  evident  that  certain  por- 
tions of  the  scale  are  being  neglected  by  rators,  or 
else  steps  on  the  scale  are  not  of  equal  value.  Donnelly 
(2)  found  in  the  preliminary  construction  of  part  III  of 
his  scale  that  the  few  items  scaled  at  the  central  portion 
of  the  scale  caused  the  scale  to  break  in  two  parts  at 
the  middle.  is  pointed  immediately  to  the  need  of 
revision  of  the  scale  in  order  to  get  more  reliable 
scores  or  results. 

E.  The  fifth  index  o.."  reliability  is  the  spread  of 

(1)  Garrett,  Henry  H.-l,Statistics  In  Psy  biology  and 

Education-pp  74-116;  longmans.  Given  Co.,  hew  York 

1926. 

(2)  Donnelly,  H.I .-“measuring  Certain  aspects  of  Faith 

In  God  as  Pound  ...  i Boys  and  Girls  Fifteen,  Sixteen, 
and  Seventeen  fears  of  age.  - Westminister  Press 

1931-P  48 
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the  distribution.  Sufficient  discrimination  between 
qualities  is  essential  in  order  to  figure  correlation 
coefficients  and  to  distinguish  between  one  individual 
and  another.  Too  great  a spread  or  range  (1)  increased 
the  error  of  any  single  rating. 

F.  The  sixth  criterion  for  increasing  the  relia- 
bility of  the  score  is  the  precluding  of  any  possibility 
of  '‘halo'1  in  the  construction  o the  scale.  This  has 
been  considered  in  the  preceding  pages. 

From  the  above  discussion  it  is  evident  that  thero 
are  difficulties  arising  due  to the  personal  elements 
involved  in  the  process  of  judging,  nevertheless,  we 
believe  the  rating  scale  to  be  a reliable  instrument 
providing : 

a.  The  final  score  is  the  average  o.  three 
independent  ratings . 

b.  The  scale  has  been  carefully  constructed. 

c.  The  three  rators  are  co  me tent . 


(1)  Garrett,  henry  E.-  Statistics  in  Is.,  cl o log,,  and 

Education-? .17;  Longmans  Green  & Go.,  few  York  1926 
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CHAPTER  IV 


THE  RATING  SC.iLE  IN  RELIGIOUS  EDUCATION. 
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A.  - The  Rating  Scale  - A supervisory  instrument* 

In  the  preceding  chapter  the  rating  scale 
was  discussed  as  an  instrument  of  measurement.  In 
this  chapter  we  will  attempt  to  show  Its  use  in  the  field 
of  Religious  Education  as  a supervisory  instrument.  This 
leads  us  to  our  first  question.  What  do  we  mean  by 
supervision? 

Religious  leaders,  including  many  so-called  re- 
ligious educators,  use  the  terms  ’administration’  and 
’supervision’  interchangeably.  Supervision  is  confused 
with  management,  administration  and  executive  work  although 
administration,  in  the  broadest  sense,  includes  super- 
vision. 

Supervision,  in  the  broadest  sense,  includes  all 
that  has  to  do  with  the  teaching  practice,  i.e.,  the 
classification  of  pupils,  teacher  training,  adjustment  of 
class  periods  etc.,  while  In  the  narrow  sense,  it  means 
the  improvement  of  those  who  actually  teach* 

Thus  the  purpose  of  supervision  is  two-fold: 

(a)  The  attainment  of  increased  skill  on  the  part 
of  the  teacher. 

(b)  The  efficient  education  of  pupils. 

In  the  light  of  this  two-fold  purpose,  the  supervisor 
will  proceed,  through  conferences  with  groups  and  indi- 
viduals, observation  of  actual  practices,  and  demon- 
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stration  work  of  various  kinds,  toward  the  goal  of 
better  teaching  and  better  educational  opportunities 
for  pupils.  Iiow  will  he  be  able  to  discern  actual 
progress?  He  must  have  some  method  of  measurement  which 
will  show  relative  improvement  of  teaching  procedure  and. 
relative  progress  in  the  lives  of  the  learners.  One 
method  is  the  use  of  rating  scales.  Thus,  the  rating 
scale  will  be  used  by  the  supervisor  in  the  rating  of 
teachers,  the  rating  of  pupils,  the  rating  of  the  pro- 
gram. 

However  this  is  not  as  simple  as  it  would  seem.  As 
has  been  pointed  out  in  the  preceding  chapter,  the  rating 
scale,  to  have  value,  assumes  time  for  at  least  three 
independent  ratings,  well  constructed  scales  and  com- 
petent rators . This  furnishes  problems  in  the  field  of 
religious  education. 

The  first  problem  is  lack  of  adequately  trained 
supervisors.  The  field  of  religious  education  is  not 
yet  sufficiently  developed  to  provide  a large  number  of 
religious  educators  who  are  competent  supervisors.  The 
large  majority  of  present  so-called  religious  educators 
have  not  had  the  background  and  training  to  enable  them 
to  build  and  use  rating  scales.  Nor  have  the  churches 
yet  developed  the  consciousness  of  the  need  for  this 
type  of  activity. 

If  we  could  at  the  present  time  assume  that  every 
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director  of  religious  education  was  a competent  super- 
visor, the  problem  would  be  lessened  but  would  not  be  met, 
because  it  is  next  to  impossible  for  a director  adequately 
to  supervise  every  phase  of  a modern  program  of  religious 
education.  Competent  supervisors  must  also  be  trained  from 
among  volunteer  workers  to  share  in  the  program  of  super- 
vision. However,  we  believe  this  to  be  a temporary  con- 
dition. Books  are  appearing  in  the  field,  (1)  courses  are 
being  offered  in  schools  of  religious  education,  courses 
are  offered  as  part  of  the  Standard  Leadership  Training 
Curriculum,  (2)  conferences  are  constantly  being  held 
(3)  and  in  time  the  need  which  we  feel  very  keenly  now  will 
be  sufficiently  met  to  make  an  adequate  supervisory  program 
possible . 

A second  problem  which  arises  in  the  program  of  rating 
as  a supervisory  function,  is  the  fact  that  teachers  are 
not  competent  rators,  i.e.,  competent  from  the  standpoint 
of  understanding  the  idea  of  measurement,  familiarity  with 
rating  scales,  familiarity  with  the  qualities  under  ob- 
servation, knowing  pupils  both  in  and  out  of  the  Church 

(1)  Chave,  E.J.-'1  Supervision  in  Religious  Education1 

University  of  Chicago  Press  1931 
IvIcKibben,  Frank  M.-  'improving  Religious  Education 

Through  Supervision“-.Iethodist  Book  Concern  1931 

(2)  Inte  -national  Council  of  Religious  Education-Bulletin 

503. 

(3)  Professional  Advisory  Sections  of  International 

Council  of  Ril.  Ed. 
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School,  and  practice  in  the  use  of  rating  scales.  This 
also,  we  believe  to  be  a temporary  condition.  Teachers' 
meetings,  training  classes,  and  personal  conferences 
between  supervisor  and  teacher,  will  eventually  help  in 
meet in  1 this  need. 

A third  problem  facing  the  supervisor  is  the  fact 
that  at  present  the  time  is  inadequate  in  the  so-called 
'’Sunday-school'1  for  a practical  sche  ie  of  rating  to  be 
carried  on.  However,  Vacation  Church  Schools,  week-day 
schools  of  religion,  club  and  society  activities  are  being 
introduced  and  dded  to  the  traditional  program,  thus 
meeting  the  problem  of  time. 

This  points  to  a fourth  need.  Activities  such  as 
the  above  are  too  often  separate  organizations  and.  en- 
tities, utilizing  different  leadership  and  developing 
separate  and  independent  programs.  V /hen  this  is  true, 
the  problem  of  providing  time  for  adequate  rating  is 
not  met,  because  of  different  leadership  and  programs. 

Only  as  the  total  program  is  unified  to  alio w the  addi- 
tional time  for  observation  of  activity  by  individual 
rators,  will  the  rating  scale  become  a valid  supervisory 
instrument.  The  lack  of  correlation  between  activities 
and  types  of  activities  has  ;iven  rise  to  a movement 
toward  the  unification  of  the  total  program.  Many  churches 
have  unified  their  programs  with  very  satisfactory  results. 
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Th.es e problems,  we  believe,  while  at  the  present 
are  evident  in  greater  or  lesser  degree,  w ill  not 
necessarily  militate  against  an  adequate  rating  pro- 
cedure as  a part  of  the  function  of  supervision,  but 
can  be  eliminated  by  the  training  of  directors  of  re- 
ligious education,  supervisors  and  teachers,  and  by 
building  a program  which  utilizes  vacation  schools, 
societies,  clubs,  week-day  schools,  and  by  the  unific- 
ation of  both  organizations  and  programs. 

E . - The  bating  of  i'eachers 

The  rating  scale  for  teachers  might  well  try  to 
evaluate  two  types  of  data:  (a)  personal  qualities 

and  habits  which  are  desirable  in  the  teacher  of  re- 
ligion, and  (b)  skill  in  teaching.  Scales  re  of . two 
forms:  (1)  the  self-rating  scale  and,  (2)  the  scale  to 
be  used  by  the  supervisor  in  judging  personality  qual- 
ities and  skills  of  the  teacher. 

At  the  present  time  there  is  little  use  made  of 
any  type  of  evaluating  instrument  in  the  selection  of 
church  school  teachers,  a superintendent  selects  almost 
any  one  he  can  get  to  take  a class,  although  in  many 
cases  the  church  board  of  religious  education  passes 
upon  his  selections  . There  is  real  need  for  ratings  as 
the  basis  for  recommending  prospective  teachers  to  the 
board  of  religious  education  for  vacancies  in  the  teaching 
staff  of  the  church. 
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It  is  also  necessary  for  the  supervisor  to  know  in 
rather  detaile  fashion  the  personal  qualities  and  habits 
of  teachers  in  service  in  order  to  aid  him  in  counseling 
with  and  guiding  individual  teachers,  and  to  aid  in  placing 
teachers  in  the  age  group  for  which  they  are  best  fitted. 

Without  the  urge  of  salary  increase  or  promotion  in 
position  which  exists  in  secular  education,  but  with  a 
motive  far  stronger  than  either  of  these,  i.e.,  belief  in 
religion  and  conviction  that  the  teaching  of  religion  to 
boys  and  girls  is  the  greatest  thing  in  life,  the  super- 
visor has  a real  opportunity  in  assisting  teachers  to 
cultivate  desirable  personal  habits  in  order  to  lake  their 
personalities  more  attractive  to  their  pupils. 

Given  a vital  religious  conviction  on • the  part  of 
the  teacher  and  a desire  to  improve  his  personal  life, 
the  self-rating  scale  offers  opportunity  for  self-evalu- 
ation anci  points  out  the  desirable  qualities,  thus  acting 
as  a spur  to  self-improvement. 

Ghave  (1)  suggests  the  first  self-rating  scale  for 
the  personal  qualities  of  religious  teachers.  This  is  a 
five  point  scale  of  four  divisions,  i.e.,  personal  qual- 
ities, leadership  qualities,  attitude  toward  work,  and 
religious  qualities.  A'  sample  of  the  scale  follows: 

(1)  Ghave,  E. J.-,rSupervision  of  Religious  Education11 
’’University  of  Chicago  Press'*  1931  page  316 
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. CHARACTERISTICS 
MANIFEST  Iff  RELIGIOUS  EDUCATION 

RATING 

Best 
10 $ 

Next 
20  $ 

Middle 

40$ 

Next 

20$ 

Ij  0 . / 0 S L 
10$ 

Ex 

Good 

Averag e 

Poor 

Bad 

1 

2 

3 

4 

5 

Personal  Qualities 

Attractive  Personality  - - - - 
Common  sense  --------- 

Industry  ----------- 

Perseverance  --------- 

Reliability  --------- 

Punctuality  --------- 

Originality  --------- 

Patience  ----------- 

Sympathy  ----------- 

Sincerity  ---------- 

Cheerfulness  --------- 

Self-control  --------- 

Adaptability  --------- 

Intellectuality  ------- 

This  is  not  a good  scale  as  it  ow  stands  because  the 


statements  of  the  qualities  is  ambiguous,  the;r  are  not  stated 
as  specific  habits,  and  they  are  not  stated  with  reference  to 
life  situations.  ~f  our  discussion  of  the  elimination  of  halo 
in  the  construction  of  the  scale  is  correct  in  chapter  three, 
this  scale  y/ould  probably  produce  ratings  which  are  influenced 
by  halo.  Howev  r,  this  is  significant  as  a beginning  and  it 
can  be  made  into  a good  self-rating  scale.  The  same  scale, 
revised  as  per  the  above  suggestions,  could  be  adapter’  to  use 
as  a diagnostic  instrument  for  the  supervisor,  both  in  the 
selection  of  teachers  and  in  the  placing  of  teachers. 
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The  self-rating  scale  is  also  a valuable  supervisory 
aid  in  stimulating  development  in  the  function  of  teaching* 
iis  yet  there  are  no  scales  of  this  sort  available  for  the 
field  of  religious  education  as  such,  but  Rugg!s  (1)  self- 
rating scale  for  teachers  in  the  secular  field  is  a type  which 
might  well  be  utilized  in  the  religious  field.  This  scale 
appears  in  two  forms.  Form  A is  a three  point  scale  of  five 
divisions,  i.e.,  (a)  Skill  in  teaching,  (b)  Skill  in  the 
mechanics  of  managing  a class,  (c)  i'eam  work  qualities,  (d) 
Qualities  of  growth  and  keeping  up  to  rate,  (e)  personal  and 
social  qualities.  Form  B is  a man- to -man  comparison,  of  the 
same  qualities  as  in  form  A.  There  are  certain  advantages  in 
this  type  of  scale. 

1.  There  is  little  or  no  overlapping  of  qualities. 

2.  Concrete  questions  are  asked  in  sentence  form. 

3.  The  teacher  r. tes  himself  in  simply  one  of  three 
groups . 

4.  The  teacher  rates  himself  on  the  same  form  on  which 
he  is  rated  by  the  supervisor. 

A sample  of  the  scale  follows: 

Form  A 


II  Skill  in  the  mechanics  of  managing  a 
class  . 

To  what  extent — 

1.  Does  the  class  work  proceed 
smoothly  (without  artificial 
interruptions  and  transitions 
from  one  kind  of  discussion 
to  another.) 


L o ./  i-i  v e r a g e Hi  p’h 


(1)  Rugg,  H.O.-’Self  Improvement  of  Teachers  Through  Self- 
ratlng'’  Vol  20  Elementary  School  Journal  pp  670-384. 
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Lo  w Average  Ili-'h. 


2.  Do  the  pupils  attend  naturally 
and  spontaneously  to  the  work 
of  the  lesson. 

3.  Does  order  or  discipline  inhere 
in  the  work  (not  maintained  by- 
compulsion  or  suppression) . 

4.  Is  routine,  as  passing  material, 
moving  to  the  blackboard,  etc., 
economically  and  systematically 
organized . 

5.  Is  material  and  equipment  in 
the  room  effectively  arranged. 

6.  Does  he  pay  attention  to  the 
details  of  heat,  light  and  ven- 
tilation. 


Summary  rating 

Form  B 


II  Skill  in  the  Mechanics  of  Managing  a class 


Best  Teacher 

38 

Better  than 

30 

Average 

22 

Poorer  than 
Average 

14 

Poorest  teacher 

6 

It  is  necessary  to  follow  any  attempt  at  self-rating  by 
a conference  between  the  supervisor  and  the  teacher  In  order 
that  a perfect  understanding  is  effected . The  supervisor 
suggests  lines  of  study,  activity,  etc.,  which  might  help  the 
teacher  and  together  they  work  out  solutions  to  the  weaknesses 
apparent  in  the  measurement. 

While  self-rating  and  self-evaluation  are  the  bases  /hich 
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provide  the  teacher  with  the  necessary  data  for  self- 
improvement  , it  is  also  necessary  for  the  supervisor  to  take 
independent  ratings  from  time  to  time  in  an  effort  to  discover 
progress  of  the  teacher  toward  the  desired  and  mutually  recog- 
nized ends.  The  instruments  used  in  this  process  is  an  adapt- 
ation of  the  rating  scale  known  as  a check  list  or  activity 
analysis.  Barr  and  Burton  (l)  describe  the  activity  analysis 
as  ''what  does,  might,  could,  should  happen  in  a lesson.  It  is 
a statement,  in  as  exact  terms  as  possible,  of  small  items  of 
actually  observable  behavior  on  the  part  of  the  teacher  or  the 
pupil.* 1 2 3 4 5 6 7'  A sample  of  a check  list  follows: 

V Some  Elements  of  weakness  often  Present  in  Lessons 

Some  of  the  common  faults  observed  in  recitations  are 
listed  by  way  of  suggesting  the  type  of  analysis  that  should 
be  made . 

1.  The  teacher  utilized  the  wrong  lesson  activity:  that 

is,  she  taught  a development  lesson  when  her  class  was 
ready  for  a practice  lesson  or  perhaps  for  a review 
lesson;  or  she  gave  a review  of  a topic  when  practice 
or  drill  was  needed. 

2.  Memory  was  the  chief  ability  required  to  suc.ceed  in 
the  recitation, 

3.  The  teacher  did  the  organizing  for  the  pupils. 

4.  One  on  two  pupils  did  all  the  talking. 

5.  The  subject  matter  was  treated  as  if  all  the  facts 
were  of  equal  importance. 

6.  In  trying  to  meet  individual  needs  the  teacher  neg- 
lected the  majority  of  the  class. 

7.  Only  one  pupil  at  a time  reponded  in  a test  lesson 
where  by  a change  of  device  all  could  have  responded; 


■ C'l  , 
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or,  by  substituting  a socialized  activity  for  a question 
and  ansv/er  type  of  lesson,  a much  more  general  particip- 
ation could  have  been  secured. 

8.  The  teacher  passed  judgment  as  to  the  concreteness  of 
statements,  thus  robbing  the  pupils  of  the  privilege  of 
judging,  and  hence,  making  learning  less  sure. 

9.  The  real  subject  matter  of  the  lesson  lay  outside  of  the 
text  and  was  not  touched  upon. 

10.  The  pupils  were  not  the  actors;  they  were  chiefly  acted 
upon  by  the  teacher. 

11.  There  was  little  or  no  problem  solving,  hence,  little  or 
no  thinking, 

12.  Up-to-date  methods  of  teaching  were  seemingly  unknown  to 
the  teacher,  such  as  diagnosis  before  drill,  individual 
practice  to  meet  individual  needs,  and  so  forth. 

13.  The  methods  of  study  of  the  pupils  were  not  taken  into 
account  nor  fostered  by  the  lesson  plan. 

14.  No  questions  were  asked  by  these  pupils.  Pupils  who  are 
really  thinking  ask  questions. 

Any  method  of  scoring  an  activity  analysis  which  is 
easiest  and  most  understandable  to  the  observer  may  be  used. 

The  data  gathered  by  the  check  list  is  used  by  the  supervisor 
as  the  basis  of  a conference  with  the  teacher  in  pointing  out 
strength  and  weakness  in  the  function  of  teaching.  Data  gathered 
in  this  way  is  also  used  to  objectify  ratings  on  the  teacher  ob- 
served • 


'i'hus  we  see  that  the  rating  of  teachers  has  value  in  the 
supervisory  function  chiefly  as  the  basis  of  discovering  need 
for  improvement  both  in  the  personal  habits  and  skills  in  teaching 
and  as  a spur  toward  achieving  that  improvement.  Therefore,  unless 


(1)  Barr  and  Burton-!,The  Supervision  of  Instruction1 11  DAppleton 

and  Company  1926  Page  116. 
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the  teacher  is  motivated  by  a desire  for  improvement  and  is 
anxious  and  willing  to  take  suggestions  from  the  supervisor, 
the  rating  scale  has  value  only  as  an  instrument  which  may  be 
used  in  gathering  information.  The  importance  of  the  teacher’s 
ability  and  yillingness  to  take  suggestion  leads  Y/agner  (1) 
to  suggest  a new  unit  of  measurement  in  scoring  rating  scales. 
Instead  of  larking  good,  poor,  fair,  etc.,  he  suggests  a 
measure  which  may  be  defined  as  the  teacher's  need  for  sugges- 
tion: 

A score  of  5-means-does  not  need  suggestion,  always  asks 
for  suggestions  of  other  teachers  or  supervisor. 

4-  Teacher  rarely  needs  suggestions.  Often 
asks  for  them  and  adopts  the  ones  needed. 

3-  Needs  suggestions  very  often  but  rarely  or 
never  asks  for  them  and  infrequently  uses 
those  offered. 

2-  Gannot  get  along  without  suggestions, 
rarely  succeeds  in  using  them. 

1-  Gan  do  nothing  without  suggestions  or  with 
suggestions . 

However,  the  supervisor’s  function  is  not  confined  solely 
with  teachers  in  service,  but  with  prospective  teachers  who  are 
in  training  as  well.  Senska  (2)  has  formulated  a 'Detailed 
Score-Card  for  hating  Student  Teachers’1  which  is  made  up  of 
the  following  divisions  with  appropriate  descriptive  subdivision^ 
Character,  Scholarship  , Teaching  skill.  Daily  preparation.  Dis- 
cipline, attitude.  Interest  in  pupil  activities,  Classroom  manawe- 

(1)  ./agner,  C.A.-'The  Construction  of  a Teacher  Rating  Scale" 
Elementary  School  Journal  Vol  21,  pp . 361-366. 
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memt,  Personality  and  health.  A sample  of  the  scale  follows: 


Characteristics 

points 

A Grade 

C Grade 

F Grade 

Character 

Stand  ards 
of  action 

Lives 
closely 
to  high- 
est ideals 

Working 

toward 

ideals 

Violates 
standard  of 
social 
group 

Service 

Helpful  in 
best  way  at 
right  time 

iielps 

when 

asked 

Self  First 

Pair  mind- 
edness 

Can  judge 
truly  even 
when  it 
hurts 

Conclusions 
drawn  from 
data  at 
hand 

Subject  to 
prejudice 

Upright- 

ness 

Glad  to  be 
thought  to 
be  just  what 
she  is 

Puts  best 
foot  for- 
ward 

Deceives  for 
the  s rke  of 
supposed 
advantage 

Mastery 
of  self 

The  spirit 
controls 
the  flesh 

Good  pur- 
poses but 
not  always 
able  to 
carry  out 

Gives  in  to 
desires  and 
whims 

Progress- 

iveness 

"lert  to 
the  best 
in  the 
new . Heady 
to  change 
for  the 
better 

Goes  with 
the  crowd 

Extremes 
appeal  or 
too  set  to 
change 

The  student  teacher  works  under  the  direction  of  a critic 
teacher,  luring  the  first  third  of  each  term  both  critic  and 
supervisor  are  expected  to  grade  every  student  teacher  on  each 
of  the  ten  classifications  o the  scale.  These  grades  are  used 
as  a starting  oint  for  improvement  with  supervisor,  critic  and 
student  working  toward  that  end.  An  estim  te  is  again  taken  at 
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the  end  of  the  year  and  the  final  grade  given. 

An  adaptation  of  this  plan  to  the  field  of  religious 
education  would  be  both  desirable  and  feasible.  Ratings  by 
critic,  supervisor  and  a self-rating  of  the  student  teacher 
■you Id  provide  the  basis  for  determining  a rather  valid  es- 
timate of  progress. 

Thus  the  rating  scale  becomes  a very  valuable  tool  for 
the  supervisor  in  religious  education  as  an  instrument  in  the 
selection  of  likely  prospects  as  teachers,  as  the  basis  for 
improvement  of  teachers  in  service,  and  as  an  instrument  for 
guiding  student  teachers. 

G . The  Rating  of  -Pupils 

The  supervisor’s  interest,  in  addition  to  the  problems  of 
improving  teachers  in  the  teaching  function,  must  also  be  very 
evident  in  the  actual  progress  of  the  learner.  Pupil  rating 
scales  will  be  of  two  types:  (a)  self-rating  scales  for  pupils 
and.,  (b ) scales  for  teachers  and  leaders  which  / ill  help  them 
in  discovering  progres  made  by  pupils  in  the  development  of 
character,  which  re  conceive  to  be  the  basic  purpose  of  re- 
ligious education.  Neumann  (1)  presents  a word  of  caution  in 
this  regard;  ‘'Character  rating  is  different  from  rating  academic 
achievement  or  needs,  ^t  is  possible  to  be  more  objective  about 
one's  proficiency  in  spelling  than  about  the  urity,  let  us  say, 
of  one’s  unselfishness,  ! and  yet  observable,  objective  data  must 

(1)  Neumann,  Henry— “Some  Doubts  About  Character  Measuring1’ 

Ril  Ed.  Vol  5:620-626 


-102- 


be  gathered,  if  we  are  to  make  valid  inferences  as  to  the  exist- 
ence or  non-existence  of  desirable,  intangible  qualities. 

The  observations  which  have  been  made  regarding  self-rating 
for  teachers  and  the  urge  toward  better  personal  life  and  better 
skills  in  teaching,  might  just  as  easily  be  made  for  the  self- 
rating and  self-evalu  .tion  of  personal  character  habits  on  the 
part  of  pupils.  Neumann  (1)  points  out,  "Charts  in  which  the 
pupils  do  their  own  rating  of  themselves  have  indeed  a certain 
usefulness.  Pupils  are  more  likely  to  Improve  when  they  are 
taught  to  look  for  more  truthfulness,  industry,  cleanliness, 

rather  th an  for  character  in  general  or  for  some  one 
trait  which  happen©  to  be  especially  interesting  to  the  teacher, 
ifhen  emphasis  is  put  on  the  constant  need  to  improve,  the  pupil 
gets  something  of  the  spur  there  is  in  playing  an  interesting 
game.  A boy  charts  a graph  for  himself,  to  indicate,  for  in- 
stance, how  steadily  or  otherwise  he  lanifests  some  ten  or  a 
dozen  desirable  traits.  He  observes  that  his  profile  is  a very 
jagged  looking  affair.  His  teacher  lets  him  see  another  pupil's 
in  /hi ch  the  liwe  is  less  rocky.  Next  month  the  boy  tries  to 
have  his  o./n  line  straighter,  ^any,  no  doubt,  .re  benefited  by 
such  a periodic  look  at  themselves  in  the  moral  mirror. ' 

Thus  with  the  aim  of  self-realiz  tion  or  personal  develop- 
ment constantly  before  the  group,  the  self-rating  scale  for 
pupils  becomes  not  only  desirable  but  necessary.  The  Presbyterian 

(1)  Neumann,  Henry-  1 Some  Doubts  about  Character  Lie  suring"  Ril  3d. 

Vol  5:620-626 
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Board  of  Christian  iducation  (1)  has  constructed  the'  first 
pupil's  self-rating  scale  of  this  sort  and  has  embodied  it  in 
a program  which  is  designed  to  stimulate  just  such  a desire 
for  individual  development.  1nis  is  a six  point  scale  of 
one  hundred  and  fifty- seven  concrete  questions  regarding 
life  habits  which  are  classified  under  the  following  headings: 

I.  Getting  and  Caring  for  Things  that  • re  Valuable, 

II.  Getting  an  Education. 

III.  Making  and  Keeping  Friends. 

IV.  Keeping  Faith  with  Bex  and  Family  Ideals. 

V.  Making,  Building,  and  Inventing  things. 

VI.  appreciating  things  that  are  Beautiful. 

VII.  Seeking  Safety  and  Peace. 

VIII,  Showing  Reverence  for  God  and  for  Religion. 

A sample  of  the  scale  follows: 

Give  yourself  a fair  and  square  rating  for  each  checking 


point . 


VIiI . Showing  Reverence  for  God  and  for  Religion. 

1.  Am  I reverent  in  my  behavior  and  attentive 
when  l go  to  church? 

2.  Am  I respectful  toward  people  Those  church 
and  religion  are  different  from  mine? 

3 . Do  I cheerfully  do  my  part  in  the  activities 
of  ray  church  and  Church  School? 

4.  Am  I regular  and  prompt  in  my  religious 
duties? 

5 . Am  I learning  what  good  it  does  to  pray? 

6.  Am  I coming  to  know  why  it  is  that  people 
think  so  much  of  the  Bible? 

7 . Do  I let  God  help  me  with  my  difficulties? 

8.  Am  I learning  how  to  join  with  other  people 

in  a service  of  worship? 


(1)  Religious  Education  Vol  5 pp • 622 


9 . Do  I enjo:  doing  what  is  right  just  because 

it  is  right  in  God's  sight? 

10.  If  I find  out  that  anyone  is  in  need,  do  1 
cohsider  it  a religious  duty  to  try  to  help 
him  out? 

11.  Do  I show  respect  for  my  religious  leaders? 

12.  Do  I keep  from  , a.1  ays  being  reverent 

in  using  the  words,  "God’*  ” Jesus  Christ  '? 

13.  am  I careful  not  to  tempt  others  to  neglect 
their  religious  duties? 

14.  Am  I doing  what  I can  to  spread  Christian 
friendliness  throughout  the  world? 

The  club  program  consists  of  a series  of  suggested  activities, 

in  which  one  an  wore  members  of  the  club  can  engage,  which 

are  designed  to  put  into  practice  the  habits  or  qualities 

described  by  the  questions  on  the  scale.  Thus  if  a boy  finds 

a very  definite  weakness  which  he  wishes  to  correct,  he  chooses 

the  type  of  activity  in  which  he  can  practice  doing  effectively 

the  type  of  tiling  under  ‘uidance  which  will  help  to  remedy 

weaknesses  which  are  apparent  to  him. 

In  this  way  the  self-rating  scale  for  pupils,  provided 

the  pupil  is  properly  motivated  with  the  desire  for  self- 

improvement,  becomes  a diagnostic  i strument  which  helps  in 

the  discovery  of  individual  needs,  and  an  evaluating  instrument 

which  helps  in  i;  bleating  progress  toward  desired  ends. 

tfugg  (1)  presents  a self-rating  scale  for  r .ting  pupils' 

dynamic  qualities  which  is  divided  into  the  following  divisions: 

(a)  Ability  to  leam-to  assimilate  new  ideas,  (b)  Qualities  of 

industry  and  attitu  e toward  school  rork,  (c)  qualities  of 

leadership,  (d)  Team-work  qualities,  and  (e)  Personal  and  Social 

(1)  Rugg,  H.O.  MRating  Scale  for  Pupils1  Dynamic  Qualities** 

School  Review  Vol  28:pp,  344-5 
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qualities.  This  scale  is  identical  in  form  to  his  scale  for 
teach: rs  w ich  has  een  described  in  the  preceding  cages.  It 
may  he  used  either  as  a self-rating  scalo  or  as  an  instrument 
in  the  hands  of  teacher  or  leader. 

chile  self-rating  of  students  is  hi  'lily  desirable  *on 
the  standpoint  of  the  learning  process,  teachers,  leaders, 
and  supervisors  -.mill  wish  to  take  r .tings  on  pupils  from  time 
to  time  in  order  to  ciscover  the  f ’ectiven  ss  o the  teaching 
function,  and  dominant  needs  to  he  met  by  the  program. 

Cornell,  Coxe  and  Orleans,  of  the  Cduc  tior.  ,1  he:.. sure: cents 
bureau.  New  York  State  Department  of  .education,  (1)  have  de- 
vised a grphic  scale  for  rating  school  habits  s an  instrument 
to  be  used  by  teachers.  This  scale  dials  with  the  oil  owing 
qualities;  attention.  Neatness,  honest.  , Interest,  Initiative, 
ambition,  Persistance,  Reliability  and  St a ility. 

A sample  of  the  scale  follows ; 

Attention 


-extreme  inability 
to  give  attention 
to  task 


Usually  pays 
attention 
can  be  dis- 
tracted 


Neatness 


always  ays 
very  close 
.ttention 
while  : tudying 
or  during 
class  priods. 


(1)  Published  by  ho  rid  Book  Company,  Yonkers-on- the  Hudson 


-106- 


The  teacher  checks  the  student’s  position  on  the  line 
which  corresponds,  in  his  ju  mient,  w 1th  the  pupil’s  status 
in  regard  to  the  quality  observed. 

A very  pretentious  attempt  to  measure  individual  growth 
in  religious  education  is  presenter  by  the  international  Council 
of  Religious  education  (1).  This  is  a five  point  scale  of 
eleven  areas  of  experie  nee  in  which  youth  lives.  T:  ese  areas 
of  experience  are  as  follows:  Health  activities,  educational 

activities,.  Economic  activities,  Vocatior  1 preparation.  Citizen- 
ship, Recreation,  Sex-parenthood-and  family  ideals,  General 
Group  Life,  Friendship,  aesthetic  Interests,  specialized  Re- 
ligious  Activities. 

The  scale  is  constructed  for  the  average  Church  leader. 

"-•ach  of  these  areas  of  experience  is  further  defined  with  appro- 
priate sub-headings,  and  the  descriptions  of  the  five  points  of 
the  scale  make  it  useable  as  the  following  sample  will  show. 


Description  of  the  five  points  of 
Areas  of  Experience  attainment . 
in  which  Youth  lives. 

Negative  Positive 


1 Bad 

2 Poor 

3 Medium 

4 Good 

5 Excellent 

3.  Economic 
Activities 
(1)  Attitude 
toward  money 

Regards 
it  as  a 
means  of 
selfish 
enjoy- 
ment 

Ignorantly 
or  indiffer- 
ent to  ri  gh- 
at t I tude  in 
money  matter 

Desir- 

able 

t attitude 
when  no 
s personal 
sacri 
fice  is 
involved 

Unsel- 

fish 

and 

generous 

Creates 
Steward- 
ship 
ideals 
in  others 

(1)  Pamphlet  #3-Christian  ^uest  Materials  "How  to  study  In- 
dividual Growth"  1927 
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astes, 

In  debt 

11  malar 

^arns . 

*.11 

(2)  Use  of 

dis- 

no  accounts 

amount  s 

Spends  by 

money 

money 

honest 
no  ef- 
fort to 
earn 

Balances 

welcome 

budget . 
Saves  . 
Gives , 

used  on 
Steward- 
ship 

basis  of 

life 

The  teacher  or  leader  chooses  the  description  which  most 


nearly  fits  the  pupil  under  observation  for  each  area  of  ex- 
perience, and  checks  it,  thus  discovering  on  which  of  the  five 
levels  from  best  to  worst,  the  pupil  lives. 

Truly  consecrated  teachers  and  leaders  in  religious 
education  catch  a new  vision  of  their  function,  when  personal 
habits  or  qualities  of  their  pupils  are  revealed  to  them  by  the 
use  of  rating  scales.  Pupils  also  catch  a new  vision  of  life 
when  they  discover  aspects  of  their  lives  which  need  improvement. 
Proper  use  o'  rating  scales  in  the  analysis  of  personal  qualities, 
may  provide  the  starting  po'.nt  for  a truly  democratic  process  of 
education,  i.e.,  teacher  and  pupil  discoverin  together  and  shar- 


ing the  best  in  life 
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0.  Rating  Tile  Program. 

The  supervisor’s  responsibility  is  not 
confined  solely  to  the  improvement  of  teachers  and 
teaching  and  results  in  the  lives  of  pupils.  He  is 
also  concerned  with  the  various  factors  which  make 
this  possible.  A teacher  may  be  a very  good  teacher, 
but,  without  adequate  facilities  with  which  to  work, 
best  results  are  not  obtained.  Equipment,  housing 
facilities  etc.,  are  important  factors  in  the  whole 
educative  process. 

The  supervisor  in  religious  education  has 
responsibility  also  for  other  elements  than  those 
which  we  commonly  associate  with  teaching  and  class- 
room activity.  The  program  of  religious  education 
is  composed  of  the  elements  of  worship,  study,  re- 
creation and  social  life,  and  service.  Study  and 
service  are  commonly  associated  with  class  activities, 
and  teacher-pupil  relationship.  Worship  and  recreation 
are  usually  group  activities  in  v/hich  several  classes 
participate.  They  are  no  less  a part  of  the  educative 
process,  however,  because  of  their  influence  on  the 
lives  of  the  participants.  It  is  therefore  necessary 
for  the  supervisor,  in  addition  .to  the  improvement  of 
teaching  to  guide  the  worship  and  social  activities 
of  the  church  into  the  most  efficient  constructive 
channels  possible.  Development  or  progress  of  this  sort 
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implies  the  need  of  some  sort  of  instrument  with 
which  to  evaluate  the  status  of  the  program  at 
any  given  time,  - the  needs  to  be  met,,  and  im- 
provement made. 

The  rating  scale  is  peculiarly  adapted 
to  uses  of  this  sort  and  has  already  been  used  for 
this  purpose  in  religious  education,  particularly 
in  score-card  form. 

For  the  sake  of  further  examination  we 
might  classify  score-cards  as;  (a)  scales  for  mea- 
suring the  whole  program  and  (b)  scales  for  measur- 
ing particular  phases  of  the  program. 

1.-  Measuring  the  Whole  Program. 

If  ? je  are  committed  to  the  seven  objectives 
listed  in  the  first  chapter  as  the  desired  goals  or 
ends  toward  which  we  must  strive  in  the  construction  of 
a program  of  religious  education;  and  if  we  are  committed 
to  the  principle  that  education  is  a process  of  gradual, 
unfolding  development,  the  elements  which  must  be  built 
into  the  program  must  be  varied  in  their  nature,  in 
order  to  provide  the  conditions  in  which  the  sense  of  a 
personal  relationship  to  God,  an  appreciation  and  under- 
standing of  the  teachings  of  Jesus,  the  development  of 
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a Christ  - like  Character,  a passion  and  concern  for 
the  welfare  of  society,  and  a new  vision  concerning 
the  function  and  the  mission  of  the  church,  can  be 
made  possible.  We  are  very  much  concerned  that  the 
elements  of  the  programs,  i.e.,  worship,  study, 
service,  social  and  recreational  life,  and  personal 
experience  in  religion  and  the  church  will^be  pro- 
vided, and  that  each  element  will  be  given  proper 
emphasis  and  each  aid  in  evaluating  the  total  pro- 
gram. 

These  instruments  are  in  score- card 
form,  and  deal  with  the  general  classifications  of 
Curriculum,  Leadership,  Or  anization  and  Adminis- 
tration, and  Housing  and  Equipment. 

The  supervisor  judges  his  program  against 
a standard,  Scoring  is  done  on  the  basis  of  1000 

points.  P sample  of  Standard  A follows: 

Perfect  School 

I Curri culum  Score Score  , _otal 


1.'  .or  ship 

70 

2. Service 

65 

3. Study 

70 

4. Social  ^Recreation 

life 

55 

5. Personal  Experience 

in  religion  and  the 

church 

65 

Total  for  Curriculum  325 


Detailed  description  of  the  standard  are  made 
to  help  the  rator  as  the  basis  for  judgment,  i.e., 

5.  Personal  Experience  in  Religion  and  the  Church 


Religious  education  should  lead  each  pupil 
to  a personal  faith  in  God,  acceptance  of  Jesus  Christ 


r 
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and  his  way  of  life,  and  membership  in  the  Church, 
Membership  and  participation  in  the  life  and  wo rk 
of  the  Church  is  not  only  an  expression  of  loyalty 
to  the  cause  of  Christ  but  a primary  means  of  growth 
in  Christian  living, 

(1)  Is  effort  made  to  help  each  pupil 
develop  an  intelligent  faith  in  God  and  an  increasing 
devotion  to  Jesus  Christ  and  his  way  of  Life? 

(2)  Is  effort  made  to  lead  those  who  are 
intelligently  and  spiritually  prepared  therefore  to 
personal  commitment  to  Jesus  Christ  and  formal  recep- 
tion into  the  church? 

(3)  Is  provision  made  for  training  in  the 
meaning  and  duties  of  church  membership? 

(4)  Is  special  effort  made  to  deepejj  the 
interest  and  increase  the  activity  of  the  new  church 
members  after  they  have  been  received? 

Standard  B,  Standard  for  the  Vacation  School, 
Standard  for  the  Y/eek-day  Schools,  are  all  similar  to  the 
above.  Departmental  standards  such  as  Standard  for  the 
Primary  Department  (1)  are  also  instruments  for  measuring 
the  total  program,  even  though  the  age  group  for  which 
it  is  used  is  restricted. 


( 1)  international  Council  of  Religious  Education  Chicago, 
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As sinning  that  the  supervisor  has  well 
defined  goals  for  the  program  he  hopes  to  build, 
score  cards  of  t is  sort  helo  in  three  ways; 

( o ) of  r nprost ' ^ 1 n f? tri',rrer' t to  discover 
status  ouo. 

(b)  as  an  evaluating  instrument  to  discern 
progress  toward  well  defined  goals* 

(c)  as  a publicity  instrument  in  aiding  the 
discovery  of  basic  needs,  and  in  defining 
them  to  a church  school  board,  as  a 

spur  to  further  progress. 

2.  Measuring  parts  of  the  program. 

Suppose  the  supervisor  was  to  discover  from  an 
evaluation  of  the  total  program  that  the  study  element 
was  too  greatly  stressed  and  that  worship,  recreation, 
etc.,  were,  by  comparison,  weak,  his  first  question 
upon  the  discovery  of  a weakness  in  a given  part 
of  the  program,  would  be,  where  is  this  part  weak 
and  how  do  I start  in  to  correct  it?  Hence,  in 
addition  to  neasu^ing  the  total  program,  the  super- 
visor must  measure,  ’rom  time  to  ime , elements 
in  or  parts  of  the  program.  This  s practically 
what  we  are  doing  when  we  utilize  a check  list 
in  the  observation  of  a teacher  in  action,  or  a 
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general  rating  of  teacher  or  pupil  activity 
of  a specialized  type. 

(1)  rpv'°  Standard  for  City  Church  Plants, 
which  has  been  described  in  chapter  three, 
in  attempting  to  discover  the  useability  of 
citrT  church  plants,  is  another  effort  to 
measure  a specific  factor  in  the  program. 

Thus  far,  however,  there  are  no  scales 
available  for  measuring  worship  activities, 
social  and  recreational  elements,  service 
activities,  and  church  contacts  and 
experiences,  which  the  supervisor  might 
utilize.  If  these  elements  are  to  be 
measured,  scales  for  this  purpose  must  be 
constructed  by  the  supervisor  himself.  How- 
ever, a committee  of  ten  members  of  a class  on  Sirveys  and 

(1)  Published  by  the  Interchurch  World  movement. 
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Measurement  In  Religions  Education  at  Boston 
University  attempted  to  build  a score  card  for 
rating  the  quality  of  worship,  a sample  of  which 
appears  herewith: 

The  main  factors  this  experiment  purposed 
to  measure  were: 


I Room  and  Equipment 
II  Worship  Program- -Materials 
III  Worship  Program- -Conduct 
IV  Leadership 

V Attitude  of  the  Worshippers 


Samples  of  scoring  and  descriptive  defini 
tions  for  scor'ng  follow. 


Perfect 


III  Worship  program, its  conduct 

Total  200 

A.  Freedom  from  distracting 

Elements 

B.  Teachers,  officers  and 
pianist  in  close  cooperation 

C.  Discipline  by  interest 

D.  Length  of  service 

TOTAL 


The  descriptive  standard  is  as  follows: 

III  Worship  program, its  conduct. 

A.  Freedom  from  distracting  elements 

a.  Doors  should  be  closed  to  tardy 
pupils  until  certain  point  in 
the  service. 


Score 


30 

50 

90 

30 


Service 

Under 

Observation 


b.  Visitors  should  be  unobtrusive 


B.  Teachers,  officers  and  pianist  in  co- 
operation with  the  leader 

a.  Responses  should  be  prompt 

b.  Prayers,  solos,  etc.,  should  be  in 
harmony  with  the  theme 

c.  Transition  between  parts  should  be 
smooth 

d.  There  should  be  a minimum  of  impromptu, 
contributions . 

G.  Discipline  by  interest. 

a.  Theme  should  be  chosen  with  the  pupil's 
interest  in  view 

b.  Interest  should  be  sustained  by 
participation 

This  projected  scale  is  still  undergoing  re- 
vision and  may  some  day  be  available. 

Experimentation  of  this  sort  will  result 
eventually  in  providing  adequate  score  cards  and 
standards  for  the  elements  in  the  program  which 
are  not  now  being  measured. 

Thus  we  see  that  the  score  card  or  rating 
scale  is  a valid  supervisory  instrument  in  evaluating 
the  total  program  of  religious  education  as  well 
as  separate  elements  in  the  program. 


CHAPTER  V 


COHCLTJSIOHS 
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If  the  rating  scale  is  carefully  constructed, 
if  the  rators  are  competent,  and  if  the  final  rating 
is  the  average  of  three  independent  ratings  by  different 
rators,  the  rating  scale  is  the  most  practicable  measur- 
ing instrument  available  for  use  in  the  supervision  of 
religious  education. 


CHAPTER  VI 


SUMMARY 
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SU1 1.  ARY 


Despite  the  fact  that  there  is  great 
need  for  refinement  in  the  process  of 
.judging  the  degree  an"  the  n ture  of  the 
intangible  qualities  which  make  for  suc- 
cess in  business,  industry,  education, 
and  similar  walks  of  life,  no  where  is 
the  need  more  evident  than  in  the  field 
of  religious  education.  This  is  due  to 
the  fact  that  the  desired  outcome  of 
religious  education  is  a process  of 
developing  a Christ-like  character  which 
expresses  itself  in  relationship  to  God, 
in  relationship  to  society,  and  in  re- 
la  ' ionship  to  the  Church,  and  that  the 
phenomena  to  be  measured  consist  of 
knowledge,  attitudes  and  motive;-,  conduct 
and  the  inter-relationship  of  all  these. 

The  measurement  movement  to  date 
has  been  chiefly  concerned  with  tests, 
although  significant  progress  has  been 
made  in  the  development  and  use  of 
rating  scale-  . Attempts  at  measurement 
in  religious  education  have  been  made 
largely  of  test  type  in  ■ hich 
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biblical  knowledge,  religious  ideas, 
ethical  discrimination,  attitudes,  and 
conduct  tests  have  received  major  atten- 
tion. 

However,  the  assumptions  that 
intangible  qualities  exist;  that  they  can 
he  so  defined  as  to  he  easily  discovered; 
that  they  are  present  in  greater  degree 
in  some  persons  than  in  others;  that  they 
can  he  inferred  from  behavior;  that  dif- 
ference in  the  degree  of  their  manifestation 
is  discernible;  that  convenient  scoring 
method  will  make  for  concreteness;  that 
accuracy  of  judgment  i;  possible  for 
carefully  defined  types  of  behavior;  and 
t^at  in  the  cultivation  of  desirable 
cualitie-s,  certain  instruments  are  nec- 
essary for  periodic  evaluation  of  pro- 
gress have  been  responsible  for  the 
evelopraent  of  four  types  of  rating 
cales,  i.e.,  the  simple  scale,  the 
graphic  scale,  the  man- to -man  comparison 
scale  and  the  score  card.  The  rating 
scale  has  not  been  universally  popular 
and  definite  opposition  has  expressed 
itself  in  the  question  of  the  existence 
of  traits,  as  non-s tatis t ical  criticism 

in  the  shape  of  problems  of  administration, 


and  statistical  criticism  which  doubts 

reliability  of  measures  ' .:ed  in 

this  fashion.  However,  well  constructed 

\ 

scales  and  the  average  of  three  independ- 
ent ratings  from  tVree  competent  .judges, 
produce  a degree  of  reliability  which 
justifies  the  use  of  the  rating  scale. 

Conditions  in  the  field  of  re- 
ligious education  at  present,  except  in 
a few  instances,  hardly  warrant  the  use 
of  the  rating  scale  due  to  lack  of  com- 
petent rators,  well  constructed  scales 
and  time  for  three  independent  judgments. 
However,  this  is  a temporary  condition 
and  ith  a better  trained  class  of 
directors  of  -reli  ious  education,  the 
rating  scale  will  become  the  chief 
supervisory  instrument  for  the  measurement 
of  teachers  and  teaching,  conduct  of 
pupils,  and  the  effectiveness  of  the  pro- 


gram 
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